Try “How do I create a LangChain chain?” or “What is a retriever?”
Offline evaluation
Retrieval quality
Measured against a labeled LangSmith documentation question set.
Loading snapshot…
Recall curve
Hit rate by cutoff
Dataset slices
Performance by difficulty
Evaluation cases
Question-level results
A labeled source URL appears in the first 5 retrieved chunks. MRR and nDCG reward relevant sources that rank closer to #1. This snapshot evaluates retrieval and the configured reranker on 100 source-grounded questions (70 dev, 30 held-out test). Answer generation is excluded.