1 min read
Rate Limit Management for AI APIs
Tomorrow we'll explore token estimation techniques. Rate Limiting Patterns Circuit Breaker Pattern Azure OpenAI Best Practices
API Management
5 articles
1 min read
Azure OpenAI Quotas: Understanding and Managing Limits
Tomorrow we'll explore rate limit management strategies. Azure OpenAI Quotas Quota Management Rate Limit Best Practices
1 min read
Advanced Azure API Management Policies
I revisit APIM policies on this blog roughly every six months because the patterns are how the service earns its keep. Rate limiting per subscription, JWT…
1 min read
Azure API Management: Policy Deep Dive
API Management is one of those services I underestimated for years. "It's a proxy, right?" The penny drops when you realise policies are the product. Rate…
1 min read
Azure API Management: API Gateway Patterns
Three years ago a client asked me to "put a gateway in front of my APIs." It turned into a six-month conversation about rate limiting, OAuth, partner…