1 min read
Building Data Pipelines with Microsoft Fabric Data Factory
Data Factory pipelines use a visual designer with activities that can be chained together.
Data Pipelines
9 articles
1 min read
Fabric Data Pipelines: Orchestrating ML Feature Engineering at Scale
For real-time inference, query the feature store directly from your model serving endpoint. Fabric's query optimization ensures millisecond-level feature…
1 min read
AI in Data Pipelines: Intelligent ETL and ELT
AI-enhanced pipelines handle complex transformations and quality issues automatically.
1 min read
AI Data Pipeline Patterns: Intelligent ETL and Processing
AI-powered pipelines transform raw data into intelligent, enriched datasets. Design for both batch and streaming scenarios.
1 min read
AI in Data Pipelines: Intelligent ETL and Data Processing
AI transforms data pipelines from rigid rule-based systems to adaptive, intelligent processes. Start with high-value, error-prone steps and expand from there.
1 min read
Testing Data Pipelines with AI: From Unit Tests to Integration Testing
AI-assisted testing catches more bugs earlier. Combine generated tests with manual review to ensure comprehensive coverage.
1 min read
Fabric Data Pipelines: Orchestration Patterns
A Fabric pipeline isn't just a sequence of activities — it's an orchestration layer with conditional branching, parameter passing, loops, and error handling…
1 min read
Fabric Pipelines: Orchestrating Data Workflows
Fabric Pipelines enable robust data orchestration with full control flow capabilities. Tomorrow, I will cover Dataflows Gen2.
2 min read
Databricks Notebook Workflows for Data Pipelines
Databricks notebook workflows—chaining notebooks together using dbutils.notebook.run()—are the stepping stone between "notebooks as scripts" and proper…