Skip to content
Back to Blog
1 min read

Fabric Data Factory Notes: designing pipelines for failure, not the happy path

I focused on making delivery decisions auditable and repeatable—documenting intent, success criteria, and rollback paths to reduce tribal knowledge.

The friction I kept seeing was simple: teams over-rotate on tooling when alignment is the real bottleneck.

Instead of adding more moving parts, I tested a short feedback loop with measurable quality gates.

By May, the quality of data and AI foundations shows up clearly in delivery speed.

What I changed today

  • I replaced a vague process step with a concrete, testable checkpoint.
  • I clarified ownership for one high-impact surface so escalations are faster.
  • I reduced unnecessary variability by standardizing one recurring pattern.

The practical lesson

The immediate gain was fewer surprises; the bigger gain is compounding trust. Most of the win comes from making ownership and boundaries unmistakably clear.

Tomorrow’s focus

Tomorrow’s focus is to stress-test this with less ideal inputs and see where it bends.

References

Michael John Peña

Michael John Peña

Senior Data Engineer based in Sydney. Writing about data, cloud, and technology.