BM25
BM25 is a lexical scoring function: it ranks documents by how well the words of a query match the words of each document, with no learned vectors involved.
-
-
Embeddings and Retrieval Representations
Retrieval quality is set by the representation: BM25 matches terms, dense embeddings match what training taught them. Learn the objectives, the failure modes, and how to measure them.