ChatGPT-Style Chat on Azure OpenAI Without a Chat API
There is no ChatGPT API yet. Here is how to build multi-turn chat on Azure OpenAI's Completions API: transcripts, state, token budgets and streaming.
Thoughts on data engineering, cloud architecture, and technology. 2205 articles and counting.
Showing 24 of 2205 posts — page 54 of 92
There is no ChatGPT API yet. Here is how to build multi-turn chat on Azure OpenAI's Completions API: transcripts, state, token budgets and streaming.
How C# 11, TypeScript 4.9 and Rust 1.66 treat tuples: naming, mutability, equality and pattern matching, and when a named type is the better choice.
Cache-aside, write-through, write-behind and refresh-ahead with Azure Cache for Redis in .NET 7 isolated Azure Functions, and when each one is the wrong choice.
Run and debug an isolated .NET Azure Functions blob trigger against Azurite, and understand the receipts, retries and limits of local testing.
What GPT-3.5 means on Azure OpenAI in January 2023: which models are in the catalogue, what they cost, and how to design for text-davinci-003's arrival.
Azure OpenAI is still a limited-access preview as 2023 starts. Here is what to settle now on access, identity, data handling and code so you're ready for GA.
Closing out 2022 from Australia on New Year's Eve, the technical predictions for 2023 feel more consequential than they ever have—because November 30…
Containerization and Kubernetes: Lessons Learned in 2022
Observability in 2022 moved beyond simple monitoring to true understanding of system behavior. OpenTelemetry became the standard for instrumentation. SLOs…
2022 established these patterns as the foundation of modern data engineering. The lakehouse became the default architecture for new data platforms. Data…
IaC maturity is a journey, not a destination. Start where you are, establish good practices early, and continuously improve. The goal is infrastructure that…
2022 brought significant security advancements in Azure, from Defender for Cloud improvements to enhanced Zero Trust capabilities. As we move into 2023,…
These scripts are my gift to you for a more efficient 2023. Start with the cleanup script to reduce waste, then implement tag compliance and scheduling.…
The holidays are the reading catch-up opportunity I look forward to all year—the stack of technical books that accumulated while the project workload was…
1. Collect metrics CPU, memory, network, IOPS 2. Analyze patterns Peak, average, trends 3. Identify candidates Under utilized resources 4. Recommend changes…
To get started with TDD in TypeScript, you will need to set up a TypeScript project and install the necessary dependencies.
I'm very surprised that there isn't a straight forward library out there that is free to use and convenient in terms of file conversion. I think it's…
Auto scaling is powerful but requires careful tuning. Start with conservative settings, monitor behavior, and adjust based on real data. Combine metric…
Spot VMs use Azure's excess capacity at significant discounts. Key characteristics: Up to 90% discount Can be evicted anytime 30 second eviction notice Best…
Azure offers reservations for: Virtual Machines Azure SQL Database Cosmos DB Storage Azure Synapse Analytics App Service Azure Databricks Azure Cache for…
Cost optimization is an ongoing practice, not a one time project. The combination of right sizing, reservations, storage optimization, and operational…
To get started with TDD in Rust, you'll need to have a few things set up. First, you'll need to have the Rust programming language installed on your system.…
The promise of serverless has largely been fulfilled: Pay only for what you use No server management Automatic scaling Faster time to market Most…
1. Carbon : Reduce the carbon emissions of software 2. Electricity : Reduce the electricity consumption 3. Carbon Intensity : Run workloads when/where…