6 min read
Qdrant 0.11 with Azure OpenAI: Point IDs, Payload Indexes and Filters
Run Qdrant 0.11 with Azure OpenAI embeddings: valid point IDs, payload indexes, filtered HNSW search, memory settings, and when Qdrant isn't the right choice.
Blog
Thoughts on data engineering, cloud architecture, and technology. 2205 articles and counting.
Showing 24 of 2205 posts — page 53 of 92
7 min read
Milvus 2.2 with Azure OpenAI Embeddings: A Self-Hosted Start
Run Milvus 2.2 standalone, load Azure OpenAI embeddings with pymilvus, and learn the schema, index, consistency and delete rules before you self-host it.
7 min read
Weaviate 1.17 with Azure OpenAI: Bring Your Own Vectors
Run Weaviate 1.17 with embeddings from Azure OpenAI: schema choices, batch imports, filtered vector search, BM25 and the hybrid search caveats to know first.
8 min read
Pinecone With Azure OpenAI Embeddings: Design the Index First
Set up a Pinecone index for Azure OpenAI embeddings: dimensions, pod types, namespaces, metadata indexing and idempotent upserts, plus when to skip it.
8 min read
Do You Need a Vector Database Yet? ANN Indexes and Trade-offs
What a vector database adds over brute force: ANN indexes, recall, filtering and updates, and how Pinecone, Weaviate, Milvus, Qdrant and pgvector compare.
8 min read
Semantic Search Prototype: Azure OpenAI Embeddings and NumPy
Build a small semantic search prototype on Azure OpenAI embeddings and NumPy, measure it with hit rate@k, add BM25, and know when to move to a real index.
8 min read
Text Embeddings on Azure OpenAI: What They Are and When to Use Them
What text embeddings are, which Azure OpenAI embeddings models you can use in January 2023, how to compare vectors, and when embeddings are the wrong tool.
7 min read
Streaming Azure OpenAI Completions from the API to the Browser
How stream=True works on the Azure OpenAI 2022-12-01 Completions API, what you give up by streaming, and how to relay tokens to a browser without losing any.
7 min read
Calling Azure OpenAI over Plain HTTP: The 2022-12-01 REST Contract
What the GA 2022-12-01 Azure OpenAI REST API looks like on the wire: URLs, auth headers, completions, embeddings, errors and when to skip the SDK.
7 min read
Azure OpenAI Is GA: What Changed on 16 January and What Didn't
Azure OpenAI Service reached GA on 16 January 2023: what that changes for production plans, what still needs an approved application, and how to proceed.
7 min read
Calling Azure OpenAI from C# Before There's an Official .NET SDK
Azure OpenAI is GA but has no official .NET SDK yet. How I'd build a thin, typed C# client over the 2022-12-01 REST API that is easy to delete later.
7 min read
Azure OpenAI from Python: Setting Up the openai 0.26 Library Properly
How to configure the openai 0.26 Python library for Azure OpenAI in January 2023: API keys or Azure AD tokens, deployment names, timeouts, retries and async.
6 min read
Completions Now, Chat Later: Keeping Azure OpenAI Code Portable
Azure OpenAI is GA with a Completions API only, and ChatGPT is coming soon. How to decide what needs chat and keep your prompt code ready for the change.
6 min read
Temperature and Top-P in Azure OpenAI: What They Actually Change
How temperature and top_p reshape token sampling in Azure OpenAI completions, why to tune one not both, and how to measure the effect before you ship.
8 min read
No System Prompt Yet: Instruction Preambles on Azure OpenAI
Azure OpenAI completion models have no system role yet. How to design, budget, version and test an instruction preamble that does that job instead.
8 min read
Chain-of-Thought Prompting on Azure OpenAI: Gains, Costs and Limits
What the 2022 chain-of-thought papers show, how to apply zero-shot CoT and self-consistency on Azure OpenAI completions, and when the extra tokens don't pay.
8 min read
Few-Shot Prompts on Azure OpenAI: Choosing and Ordering Examples
How to pick, order and budget few-shot examples for Azure OpenAI completion models, with the biases to watch for and when to stop adding examples.
7 min read
Prompts Are Production Code: Four Rules for Azure OpenAI Completions
Four prompt rules that hold up against real user input on Azure OpenAI completions: positive instructions, strict formats, delimiters and roles, plus tests.
8 min read
Counting and Capping Tokens in the Azure OpenAI Preview
How to count tokens with tiktoken, size max_tokens, log real usage and cap spend for Azure OpenAI completion models in the January 2023 preview.
7 min read
Throttling in the Azure OpenAI Preview: Pacing Per-Deployment Requests
Azure OpenAI preview limits are requests per second per deployment. How to pace calls, retry 429s properly and scale out with the openai 0.26 Python library.
7 min read
Handling Content Filtering in the Azure OpenAI Completions API
How Azure OpenAI's preview content filter shows up in code: HTTP 400 prompts, content_filter finish reasons, and why you still need your own guardrails.
8 min read
Responsible AI on Azure OpenAI: What the Platform Covers and What You Own
Azure OpenAI's preview ships with use-case review, content filtering and abuse monitoring. Here is where those controls stop and your application's begin.
7 min read
Azure OpenAI vs OpenAI API: What Differs in January 2023
Azure OpenAI or OpenAI's own API in January 2023? Access, models, data use, cost and code compared, plus one Python client that can target either.
8 min read
Locking Down an Azure OpenAI Resource: Network, Identity, Keys, Logs
A security baseline for an Azure OpenAI preview resource in January 2023: private endpoints, Azure AD auth, customer-managed keys, logging and policy.