1 min read
Streaming Design Notes in Fabric: keeping streaming dashboards useful after week one
I focused on making delivery decisions auditable and repeatable—documenting intent, success criteria, and rollback paths to reduce tribal knowledge.
Real-Time
41 articles
1 min read
Real-Time Intelligence in Fabric: aligning action thresholds with business impact
I worked on smoothing the handoff between data engineering and AI teams—standardizing feature contracts, embedding validation, and adding lightweight…
1 min read
Streaming Design Notes in Fabric: using KQL to separate noise from meaningful changes
I focused on making delivery decisions auditable and repeatable—documenting intent, success criteria, and rollback paths to reduce tribal knowledge.
1 min read
KQL and Operational Awareness: using KQL to separate noise from meaningful changes
I spent the day reducing cognitive overhead for engineers and analysts—introducing clearer table contracts, simpler failure modes, and concise runbooks that…
1 min read
Real-Time Signals That Actually Help: building alerting that avoids fatigue
I turned implicit processes into explicit operating rules—defining owners, acceptance tests, and lightweight runbooks so teams can move confidently and…
1 min read
Real-Time Signals That Actually Help: keeping streaming dashboards useful after week one
I spent the day reducing cognitive overhead for engineers and analysts—introducing clearer table contracts, simpler failure modes, and concise runbooks that…
3 min read
Real-Time Intelligence in Microsoft Fabric: A Working Example
Here's what it is, how it works, and a pattern that's running in production. Traditional analytics is batch-oriented. Data lands in storage, gets processed…
1 min read
Building Real-Time Dashboards with Azure SignalR and React
Real-time dashboards are now straightforward with Azure SignalR. The serverless model means you only pay for messages, making it cost-effective for most…
1 min read
Microsoft Fabric Data Activator: Event-Driven Data Alerts
Data Activator monitors data streams and triggers actions based on conditions you define. It connects to Power BI reports, Eventstreams, and Fabric data…
1 min read
Streaming Inference Patterns: Processing Data as It Flows
Streaming inference brings AI insights to real-time data. Design for throughput, latency, and reliability from the start.
1 min read
Real-Time AI Patterns: Building Low-Latency Intelligent Systems
Real-time AI requires discipline around latency. Design for the worst case and optimize for the common case.
1 min read
Real-Time AI: Streaming Inference for Live Data Applications
Real-time AI requires careful architecture to balance latency, cost, and quality. Start with simple use cases and optimize based on actual performance data.
1 min read
Fabric Eventstream Enhancements: Real-Time Data at Scale
Eventstream enhancements make real-time analytics more powerful and accessible. Start with simple streaming scenarios and progressively add complexity.
1 min read
Change Data Capture in Microsoft Fabric
CDC captures row level changes (inserts, updates, deletes) from source systems: The simplest option for supported sources: For more control over the CDC…
1 min read
Real-Time Sync Patterns in Microsoft Fabric
For sub second latency: For minute level latency with relational sources: Combine streaming and batch for different data types: Distribute data to multiple…
1 min read
Fabric Mirroring GA: Real-Time Database Replication
Mirroring creates a continuously synchronized copy of your operational database in OneLake as Delta Lake tables: As of GA: Azure SQL Database : Full support…
1 min read
Latency-Based LLM Routing: Real-Time AI Applications
Latency has multiple components: 1. Network latency : Request travel time 2. Queue time : Waiting for processing 3. Time to first token (TTFT) : Initial…
1 min read
Data Activator GA: Automated Actions from Data
Data Activator monitors your data and triggers actions when conditions are met: A Reflex is a Data Activator item containing: Objects : Entities to monitor…
1 min read
Online Feature Serving in Databricks: Real-Time ML Features
Online feature serving enables real-time ML inference by providing low-latency access to features. This guide covers setting up and using Databricks online…
1 min read
Real-Time Transcription with Azure AI Speech
Build real-time transcription applications using Azure AI Speech services with low latency and high accuracy.
1 min read
Eventstreams in Fabric: Streaming Data Ingestion
Tomorrow we'll explore Real Time Dashboards for visualizing streaming data. Eventstream Documentation Event Hub Integration Streaming Best Practices
1 min read
Response Streaming: Real-Time LLM Output
Streaming improves the user experience significantly. Tomorrow, I will cover error handling for AI applications.
1 min read
Fabric Mirroring: Real-Time Database Replication
Mirroring simplifies real-time data replication to Fabric. Tomorrow, I will cover Git integration in Fabric.
1 min read
Building Real-Time Dashboards with Citus
Combining Citus's distributed query power with rollup tables and caching enables dashboards that handle millions of events per second.
1 min read
Azure Stream Analytics Updates: No-Code Editor and More
The new visual editor allows building streaming pipelines without SQL: 1. Drag and drop input/output connections 2. Visual transformations and aggregations…
1 min read
Real-Time Analytics on Azure: Building Live Dashboards
Azure's real time analytics stack enables instant insights from millions of events per second, powering live dashboards and alerts.
1 min read
Azure Web PubSub: Native WebSocket at Scale
Azure Web PubSub offers native WebSocket support with powerful server side messaging APIs, ideal for IoT, gaming, and collaboration apps.
1 min read
SignalR Scaling: Building Scalable Real-Time Applications
Azure SignalR Service scales real time applications effortlessly, handling millions of connections with automatic load balancing.
1 min read
Long Polling: Real-Time Patterns for Legacy Systems
Long polling is the workaround for near-real-time notifications in environments where WebSocket connections aren't available—the client sends an HTTP…
1 min read
Server-Sent Events: Simple Real-Time Updates
Feature SSE WebSocket Direction Server to client Bidirectional Protocol HTTP WebSocket Reconnection Automatic Manual Binary data No Yes SSE offers a simple,…
1 min read
GraphQL Subscriptions: Real-Time Data with Azure
GraphQL subscriptions provide elegant real time communication, ideal for dashboards, notifications, and live updates.
1 min read
Azure Communication Services: Building Connected Experiences
Voice and video calling Chat messaging SMS messaging Email communication Phone number management Create and configure your Communication Services resource:…
1 min read
Streaming Tables in Delta Live Tables
DLT streaming tables use append mode by default. For aggregations: DLT handles checkpointing automatically: Streaming tables in Delta Live Tables provide:…
1 min read
Real-Time Speech Translation with Azure Cognitive Services
All three happen with minimal latency for real-time conversations.
1 min read
Power BI Hybrid Tables: Real-Time Meets Historical
Hybrid tables provide the perfect balance between real-time data freshness and historical data performance.
1 min read
Azure Stream Analytics for Real-Time Data Processing
Azure Stream Analytics sits in a specific niche that I've come to appreciate: SQL-native stream processing for teams who shouldn't have to learn Spark or…
2 min read
Building Real-Time Applications with Azure SignalR Service
Azure Web PubSub is the lower-level real-time service that sits alongside SignalR. Where SignalR abstracts the transport and provides a hub model for your…
1 min read
Real-Time Web Applications with Azure SignalR Service
I've tried to roll my own WebSocket fanout exactly once. It worked beautifully for 200 concurrent connections and melted at 2,000. Azure SignalR Service…
2 min read
Building Video Calling Apps with Azure Communication Services
Azure Communication Services launched late last year, and "build your own video calling app on the same backbone as Teams" is the pitch that makes it click…
1 min read
Azure Stream Analytics: Real-Time Data Processing
Stream Analytics is one of those services I keep recommending and clients keep being surprised by — SQL on top of an event firehose, with windowing and…