philschmid / evaluate-llmsLinks
Includes examples on how to evaluate LLMs
☆23Updated 11 months ago
Alternatives and similar repositories for evaluate-llms
Users that are interested in evaluate-llms are comparing it to the libraries listed below
Sorting:
- Sample notebooks and prompts for LLM evaluation☆151Updated last week
- Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging co…☆113Updated last year
- A semantic research engine to get relevant papers based on a user query. Application frontend with Chainlit Copilot. Observability with L…☆82Updated last year
- Fine-tune an LLM to perform batch inference and online serving.☆112Updated 4 months ago
- Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.☆124Updated 2 weeks ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆50Updated last year
- ☆80Updated last year
- Mistral + Haystack: build RAG pipelines that rock 🤘☆106Updated last year
- Scripts, notebooks, and articles about data science in general.☆52Updated 2 years ago
- ☆146Updated last year
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆116Updated 6 months ago
- ☆15Updated 2 years ago
- Material for the series of seminars on Large Language Models☆34Updated last year
- Seemless interface of using PyTOrch distributed with Jupyter notebooks☆50Updated last month
- The application of multimodal RAG for Sustainable finance☆23Updated last year
- An index of all of our weekly concepts + code events for aspiring AI Engineers and Business Leaders!!☆86Updated this week
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆143Updated this week
- Examples of using Evidently to evaluate, test and monitor ML models.☆40Updated 3 weeks ago
- ☆23Updated 2 years ago
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- ☆14Updated last year
- Document Q&A on Wikipedia articles using LLMs☆79Updated 2 years ago
- ☆88Updated 2 years ago
- Explore the use of DSPy for extracting features from PDFs 🔎☆46Updated last year
- A set of scripts and notebooks on LLM finetunning and dataset creation☆110Updated last year
- GenAI Experimentation☆57Updated last month
- ☆20Updated last year
- Test LLMs automatically with Giskard and CI/CD☆31Updated last year
- Simple introduction to LLM Agents☆139Updated last year
- This repo is the central repo for all the RAG Evaluation reference material and partner workshop☆76Updated 5 months ago