philschmid / evaluate-llmsLinks
Includes examples on how to evaluate LLMs
☆23Updated last year
Alternatives and similar repositories for evaluate-llms
Users that are interested in evaluate-llms are comparing it to the libraries listed below
Sorting:
- Fine-tune an LLM to perform batch inference and online serving.☆117Updated 8 months ago
- ☆80Updated last year
- ☆147Updated last year
- A semantic research engine to get relevant papers based on a user query. Application frontend with Chainlit Copilot. Observability with L…☆81Updated last year
- Sample notebooks and prompts for LLM evaluation☆159Updated 2 months ago
- Codebase accompanying the Summary of a Haystack paper.☆80Updated last year
- ☆89Updated 2 years ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆51Updated last year
- Mistral + Haystack: build RAG pipelines that rock 🤘☆106Updated last year
- This repo is the central repo for all the RAG Evaluation reference material and partner workshop☆79Updated 9 months ago
- ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…☆113Updated last year
- Seemless interface of using PyTOrch distributed with Jupyter notebooks☆57Updated 4 months ago
- ☆15Updated 2 years ago
- Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.☆166Updated last year
- ☆75Updated last year
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- An index of all of our weekly concepts + code events for aspiring AI Engineers and Business Leaders!!☆97Updated 2 weeks ago
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆174Updated last week
- Dynamic Metadata based RAG Framework☆78Updated last month
- A collection of hand on notebook for LLMs practitioner☆51Updated last year
- Data extraction with LLM on CPU☆112Updated 2 years ago
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆119Updated 10 months ago
- Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.☆50Updated 2 years ago
- GenAI Experimentation☆59Updated 5 months ago
- Explore the use of DSPy for extracting features from PDFs 🔎☆52Updated last year
- Optimized Large Language Models for Financial Applications – Efficient, Scalable, and Domain-Specific AI for Finance.☆50Updated 6 months ago
- Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.☆133Updated last week
- A framework for fine-tuning retrieval-augmented generation (RAG) systems.☆139Updated last week
- ☆105Updated 10 months ago
- Applying Evaluation Driven Development (EDD) to aid in the design decision of RAG pipelines☆31Updated 2 years ago