8 min read
AI Product Lessons: Users Want Augmentation, Not Automation
What building AI features for six products taught me: users want their existing tasks done faster, visible uncertainty and easy overrides, not chat.
UX
4 articles
1 min read
Response Streaming: Real-Time LLM Output
Streaming improves the user experience significantly. Tomorrow, I will cover error handling for AI applications.
1 min read
Streaming Responses with Azure OpenAI
Streaming transforms AI applications from feeling sluggish to feeling responsive. The implementation adds complexity, but the UX improvement is substantial.…
7 min read
Streaming Azure OpenAI Completions from the API to the Browser
How stream=True works on the Azure OpenAI 2022-12-01 Completions API, what you give up by streaming, and how to relay tokens to a browser without losing any.