Evaluating Retrieval and Answers Separately
One accuracy number cannot say whether a RAG failure came from retrieval, context selection, or generation. Score each stage, audit the judges, and diagnose by stage.
-
-
Grounded Answer Generation and Abstention
Retrieval can succeed and the answer can still be a confident guess. Select evidence, check citations, resolve conflicts, abstain when the evidence is missing, and verify.
-
Hybrid Retrieval and Reranking
Sparse and dense retrievers fail on different queries. Learn how to fuse them, where a reranker helps or hurts, how to rewrite queries without losing exact terms, and how to benchmark each stage.
-
Building a Retrieval Index with Traceable Evidence
A retrieval index is derived data. Give every chunk an exact source span, name each index build, update approximate indexes without silent recall loss, and test for stale evidence.
-
Retrieval-Augmented Generation and Agents
A model’s weights are a lossy, frozen snapshot of the world. Retrieval is how you stop relying on them.