aiverify-foundation / LLM-Evals-Catalogue
This repository stems from our paper, “Cataloguing LLM Evaluations”, and serves as a living, collaborative catalogue of LLM evaluation frameworks, benchmarks and papers.
☆17Updated last year
Alternatives and similar repositories for LLM-Evals-Catalogue:
Users that are interested in LLM-Evals-Catalogue are comparing it to the libraries listed below
- Sample notebooks and prompts for LLM evaluation☆124Updated 4 months ago
- An index of all of our weekly concepts + code events for aspiring AI Engineers and Business Leaders!!☆63Updated this week
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆104Updated last week
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆107Updated 6 months ago
- ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…☆102Updated 11 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 8 months ago
- Mistral + Haystack: build RAG pipelines that rock 🤘☆103Updated last year
- ☆71Updated 5 months ago
- ☆120Updated last month
- RAGArch is a Streamlit-based application that empowers users to experiment with various components and parameters of Retrieval-Augmented …☆84Updated last year
- LangFair is a Python library for conducting use-case level LLM bias and fairness assessments☆197Updated 3 weeks ago
- ☆143Updated 8 months ago
- LangChain, Llama2-Chat, and zero- and few-shot prompting are used to generate synthetic datasets for IR and RAG system evaluation☆38Updated last year
- ☆29Updated last year
- Testing and evaluation framework for voice agents☆102Updated last month
- Automated knowledge graph creation SDK☆121Updated 4 months ago
- A collection of fine-tuning notebooks!☆26Updated last year
- 🦜💯 Flex those feathers!☆244Updated 5 months ago
- ☆45Updated 11 months ago
- ☆76Updated 10 months ago
- ☆41Updated last year
- Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging co…☆108Updated 8 months ago
- ☆79Updated 6 months ago
- ☆19Updated last year
- All code related to medium articles☆17Updated this week
- This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data☆68Updated last year
- Optimized Large Language Models for Financial Applications – Efficient, Scalable, and Domain-Specific AI for Finance.☆46Updated last week
- Fiddler Auditor is a tool to evaluate language models.☆178Updated last year
- Simple examples using Argilla tools to build AI☆52Updated 4 months ago
- ☆88Updated last year