1 min read
Circuit Breakers for AI Systems: Preventing Cascade Failures
Circuit breakers are essential for AI systems that depend on external APIs. They prevent resource exhaustion, protect downstream services, and enable…
Resilience
13 articles
1 min read
Graceful Degradation in AI Systems: Maintaining Service Quality
Graceful degradation is about providing the best possible experience given current constraints. Plan for every level of degradation and communicate clearly…
1 min read
Fallback Patterns for AI Applications: Ensuring Continuity
Fallback patterns ensure your AI application remains useful even when primary services fail. Design your fallbacks to maintain the best possible user…
1 min read
Retry Strategies for AI Applications: Beyond Simple Backoff
Smart retry strategies balance reliability with resource efficiency. The key is adapting behavior based on error type, system state, and business requirements.
1 min read
Multi-LLM Strategies: Building Resilient AI Applications
Resilience : Failover when one provider has outages Cost optimization : Route to cheaper models when possible Capability matching : Use best model for each…
1 min read
Circuit Breakers for AI Applications: Preventing Cascade Failures
This concludes our June 2023 series on Azure, Data, and AI topics. We covered: Microsoft Fabric deep dives (Lakehouse, Delta Lake, OneLake) Power BI Direct…
1 min read
Fallback Patterns for AI Applications
Fallback patterns ensure continuous service availability. Tomorrow, I will cover circuit breakers for AI applications.
1 min read
Retry Strategies for AI Applications
Azure OpenAI rate limits in mid-2023 are set per deployment per region, and hitting them is a normal operating condition rather than an exceptional one for…
1 min read
Error Handling for AI Applications: Building Resilient Systems
Robust error handling ensures AI applications remain useful even during failures. Tomorrow, I will cover retry strategies in more depth.
7 min read
Calling Azure OpenAI from C# Before There's an Official .NET SDK
Azure OpenAI is GA but has no official .NET SDK yet. How I'd build a thin, typed C# client over the 2022-12-01 REST API that is easy to delete later.
7 min read
Throttling in the Azure OpenAI Preview: Pacing Per-Deployment Requests
Azure OpenAI preview limits are requests per second per deployment. How to pace calls, retry 429s properly and scale out with the openai 0.26 Python library.
1 min read
Azure Chaos Studio: Chaos Engineering for Resilient Applications
Chaos engineering is the practice of experimenting on a system to build confidence in its ability to withstand turbulent conditions. Netflix pioneered this…
1 min read
Circuit Breaker Pattern with Polly and Azure
The Circuit Breaker pattern is essential for building resilient microservices. Polly provides a mature implementation with advanced features like sampling…