aiverify-foundation / LLM-Evals-CatalogueLinks
This repository stems from our paper, “Cataloguing LLM Evaluations”, and serves as a living, collaborative catalogue of LLM evaluation frameworks, benchmarks and papers.
☆17Updated last year
Alternatives and similar repositories for LLM-Evals-Catalogue
Users that are interested in LLM-Evals-Catalogue are comparing it to the libraries listed below
Sorting:
- Sample notebooks and prompts for LLM evaluation☆131Updated this week
- A framework for fine-tuning retrieval-augmented generation (RAG) systems.☆69Updated this week
- ☆143Updated 10 months ago
- Mistral + Haystack: build RAG pipelines that rock 🤘☆105Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 10 months ago
- ☆86Updated 3 weeks ago
- A collection of fine-tuning notebooks!☆27Updated last year
- An index of all of our weekly concepts + code events for aspiring AI Engineers and Business Leaders!!☆72Updated 2 weeks ago
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆118Updated 3 weeks ago
- ☆45Updated last year
- ☆19Updated last year
- ☆72Updated 7 months ago
- ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…☆104Updated last year
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆110Updated 8 months ago
- Notebooks and articles related to LLMs☆26Updated last year
- Automated knowledge graph creation SDK☆122Updated 6 months ago
- ☆29Updated last year
- Fiddler Auditor is a tool to evaluate language models.☆181Updated last year
- ☆89Updated last year
- A practical RAG where you can download and chat with github repo☆80Updated 3 months ago
- ☆77Updated last year
- ☆72Updated last year
- Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)☆113Updated 3 months ago
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆97Updated 7 months ago
- All code related to medium articles☆17Updated 2 weeks ago
- ☆34Updated last month
- ☆37Updated 10 months ago
- Repository for “PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers”, NAACL24☆138Updated 11 months ago
- Source code for our paper: "SelfGoal: Your Language Agents Already Know How to Achieve High-level Goals".☆66Updated 11 months ago
- Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.☆132Updated last month