8 min read
Idempotent Writes, and Why Retries Duplicate Data
Every pipeline gets retried eventually, and a non-idempotent write turns each retry into duplicates. Four patterns that make a write safe to repeat.
Pipelines
10 articles
1 min read
Azure Machine Learning Pipelines: Orchestrating ML Workflows
Configure pipelines to run on schedules or in response to data changes, enabling fully automated ML operations with minimal manual intervention.
1 min read
Data Factory in Microsoft Fabric: Modern Data Integration
Data Pipelines in Fabric are similar to Azure Data Factory pipelines but with deeper Fabric integration.
1 min read
Advanced Checks in Azure DevOps Pipelines
Checks provide automated validation gates for enterprise deployments.
1 min read
Azure Pipelines Improvements
Azure Pipelines templates and stages enable maintainable, scalable CI/CD implementations.
1 min read
Azure ML Pipelines v2: Modern ML Workflows
Azure ML Pipelines v2 provides a modern, Pythonic way to build production-ready ML workflows.
8 min read
Azure DevOps in 2022: Lock Down Your YAML Pipelines First
Going into 2022, the Azure Pipelines features worth adopting are the security controls: environments, checks, protected repos and scoped tokens.
2 min read
Building ML Workflows with Azure Machine Learning Pipelines
The first ML pipeline I helped build was a series of Python scripts duct-taped together with a bash wrapper and a nightly cron job. It worked exactly as…
1 min read
Azure Machine Learning Pipelines: MLOps Workflows
The first ML model I helped put into production was a notebook a data scientist ran by hand every Monday morning. That worked exactly as well as you'd…
1 min read
Azure DevOps Pipeline Templates: Reusable CI/CD
Templates transform pipeline chaos into maintainable, standardized CI/CD.