HindsightFrom the builder

We Added Jev as a Reranker. Here's What We Learned.

Hindsight added TypeSafe's Jev as a reranker for recall results in version 0.10.1 and described the process: the obvious per-candidate relevance check was still pairwise, so it instead asks one multiple-choice question over the whole candidate pool and gets the full ordering in a single request. Hindsight says two designs that let the model say nothing here is relevant failed, so ranking ships on and filtering ships off. At 30 candidates recall@1 rose from 0.800 with the default to 0.950 and per-query time fell from 0.12 to 0.027 seconds, though Jev is a hosted third-party API that will not suit every deployment.

Official blogSep 25, 20268 min read