aiverify-foundation / LLM-Evals-CatalogueLinks
This repository stems from our paper, “Cataloguing LLM Evaluations”, and serves as a living, collaborative catalogue of LLM evaluation frameworks, benchmarks and papers.
☆17Updated last year
Alternatives and similar repositories for LLM-Evals-Catalogue
Users that are interested in LLM-Evals-Catalogue are comparing it to the libraries listed below
Sorting:
- Sample notebooks and prompts for LLM evaluation☆135Updated 2 weeks ago
- ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…☆107Updated last year
- Mistral + Haystack: build RAG pipelines that rock 🤘☆105Updated last year
- An index of all of our weekly concepts + code events for aspiring AI Engineers and Business Leaders!!☆75Updated 2 weeks ago
- All code related to medium articles☆17Updated this week
- ☆72Updated 8 months ago
- ☆45Updated last year
- ☆19Updated last year
- ☆87Updated last month
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆122Updated last month
- ☆144Updated 11 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 11 months ago
- Fiddler Auditor is a tool to evaluate language models.☆183Updated last year
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆98Updated 8 months ago
- Codebase accompanying the Summary of a Haystack paper.☆78Updated 9 months ago
- Create a knowledge graph out of unstructed legal text - use said knowledge graph in a graph augmented retrieval augmented generation pipe…☆50Updated 9 months ago
- This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data☆68Updated last year
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆71Updated 7 months ago
- A library for evaluating Retrieval-Augmented Generation (RAG) systems (The traditional ways).☆36Updated 10 months ago
- A semantic research engine to get relevant papers based on a user query. Application frontend with Chainlit Copilot. Observability with L…☆83Updated last year
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆112Updated 2 weeks ago
- Notebooks and articles related to LLMs☆26Updated last year
- A framework for fine-tuning retrieval-augmented generation (RAG) systems.☆112Updated this week
- LlamaWorksDB is a Retrieval Augmented Generation (RAG) product designed to interact with the documentation of various products such as Ll…☆16Updated last year
- A practical RAG where you can download and chat with github repo☆82Updated 4 months ago
- ☆77Updated last year
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆111Updated 9 months ago
- ☆42Updated last year
- Simple examples using Argilla tools to build AI☆53Updated 7 months ago
- 🧪 Experimental features for Haystack☆46Updated this week