Curating Training Data and Managing Feedback
A training set is a product with a specification. This post covers sampling, labels, provenance, dataset versions, feedback quality, contamination checks, and privacy limits.
-
-
Preserving Access Controls in Retrieval Data
A retrieval index is a copy of documents, and copies do not inherit permissions. This post follows permissions from source ACLs through identity, filtering, revocation, and leakage tests.
-
Document Pipelines for Retrieval
A retrieval index is derived data. Track which document version produced each chunk, refresh only what changed, delete everywhere, and validate before publishing.
-
Feature Pipelines and Point-in-Time Correctness
A feature value is a claim about what a system knew at prediction time. Learn the clocks, joins, parity checks, and backfill rules that keep that claim true.