Skip to content
Back to Blog
1 min read

What Improved My RAG Pipeline: why citation UX matters as much as relevance

I worked on smoothing the handoff between data engineering and AI teams—standardizing feature contracts, embedding validation, and adding lightweight integration tests.

The friction I kept seeing was simple: quality regressions are expensive because they are discovered too late.

Instead of adding more moving parts, I tested a short feedback loop with measurable quality gates.

April is where Q2 intentions either become systems or remain slideware.

What I changed today

  • I clarified ownership for one high-impact surface so escalations are faster.
  • I reduced unnecessary variability by standardizing one recurring pattern.
  • I removed one optional branch that only added maintenance burden.

What I want to keep doing

The immediate gain was fewer surprises; the bigger gain is compounding trust. I keep seeing the same thing: reliability improves when we reduce hidden decisions.

Tomorrow’s focus

Tomorrow’s focus is to stress-test this with less ideal inputs and see where it bends.

References

Michael John Peña

Michael John Peña

Senior Data Engineer based in Sydney. Writing about data, cloud, and technology.