- Notebook: demo_es.ipynb
Plan for the section:
- Why do we need evaluation
- Evaluation metrics
- Ground truth / gold standard data
- Generating ground truth with LLM
- Evaluating the search resuls
- Approaches for getting evaluation data
- Using OpenAI to generate evaluation data
Links:
- Elasticsearch with text results
- minsearch
Links:
- Elasticsearch with vector search
- Ranking with question, answer, question+answer embeddings
Links:
See here
- Notes by dimzachar
- Notes by slavaheroes
- Notes on Vector Search and Vector Databases by Marat
- Did you take notes? Add them above this line (Send a PR with links to your notes)