Ask a grounded question over the indexed LangChain documentation. Answers include retrieved passages, ranks, and source citations.
Offline evaluation
Retrieval quality
Measured against a labeled LangSmith documentation question set.
Loading snapshot…
Recall curve
Hit rate by cutoff
Dataset slices
Performance by difficulty
No matching questions.
A labeled source URL appears in the first 5 retrieved chunks. MRR and nDCG reward relevant sources that rank closer to #1. This snapshot evaluates retrieval and the configured reranker on 100 source-grounded questions (70 dev, 30 held-out test). Answer generation is excluded.