Recall@k
also: recall@1 · recall@5 · nDCGShare of queries whose right answer appears in the top k results. With nDCG, the core of our labelled retrieval evaluation.
Our embedder and both rerankers we tested are sold as multilingual. Measured with paired Slovak and English queries, Slovak failed 55% of the time against 20%, and a cross-encoder gave three different documents the identical score.
Our unified search compared three different quantities in one column. The exact answer ranked below a weaker one, purely because of scale. What we measured, and what we changed.
Retrieval finds the nearest item. Search composes an answer from parts, the way a chemist plans a molecule backwards from what is on the shelf. The map we took from the chemistry, and what it changes in an agent.
Two passing evaluations in one day, both blind to the change they were meant to judge. What they missed, and the rule we took from it.