Who it's for
Product teams whose search, recommendations, feeds or notifications don't surface the right thing.
What we deliver
- A relevance audit with judged queries.
- Hybrid retrieval.
- Rerankers and learning-to-rank.
- Personalization.
- Offline metrics tied to online A/B tests, so improvements are real.
How we measure it
- nDCG, MRR and recall offline.
- Click-through, conversion and retention in experiments.
Background
And led the recommendations and personalization machine learning team at Quizlet, was Head of Recommendations Platform and Science at Etsy and worked on large-scale experimentation at Pinterest. The RAG retrieval quality benchmark below reports the same ranking metrics, such as MRR, used to judge search.