philschmid / evaluate-llmsLinks
Includes examples on how to evaluate LLMs
☆23Updated last year
Alternatives and similar repositories for evaluate-llms
Users that are interested in evaluate-llms are comparing it to the libraries listed below
Sorting:
- A semantic research engine to get relevant papers based on a user query. Application frontend with Chainlit Copilot. Observability with L…☆81Updated last year
- Fine-tune an LLM to perform batch inference and online serving.☆120Updated 8 months ago
- ☆80Updated last year
- Complete example of how to build an Agentic RAG architecture with Redis, Amazon Bedrock, and LlamaIndex.☆99Updated last year
- Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.☆166Updated last year
- ☆75Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆51Updated last year
- Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.☆134Updated 2 weeks ago
- ☆147Updated last year
- Mistral + Haystack: build RAG pipelines that rock 🤘☆106Updated 2 years ago
- ☆90Updated 2 years ago
- This repo is the central repo for all the RAG Evaluation reference material and partner workshop☆80Updated 9 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆115Updated 9 months ago
- Optimized Large Language Models for Financial Applications – Efficient, Scalable, and Domain-Specific AI for Finance.☆50Updated 7 months ago
- A framework for fine-tuning retrieval-augmented generation (RAG) systems.☆139Updated 3 weeks ago
- ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…☆113Updated last year
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- Sample notebooks and prompts for LLM evaluation☆159Updated 3 months ago
- Dynamic Metadata based RAG Framework☆78Updated 2 months ago
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆119Updated 10 months ago
- ☆15Updated 2 years ago
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆176Updated 2 weeks ago
- GenAI Experimentation☆59Updated 5 months ago
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆116Updated 6 months ago
- Codebase accompanying the Summary of a Haystack paper.☆80Updated last year
- Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging co…☆117Updated last year
- Seemless interface of using PyTOrch distributed with Jupyter notebooks☆57Updated 4 months ago
- Examples of using Evidently to evaluate, test and monitor ML models.☆48Updated last month
- Data extraction with LLM on CPU☆112Updated 2 years ago
- ☆44Updated last year