prometheus-eval / prometheus-eval
Evaluate your LLM's response with Prometheus and GPT4 💯
☆794Updated 2 months ago
Related projects ⓘ
Alternatives and complementary repositories for prometheus-eval
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆1,612Updated this week
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆787Updated last week
- ☆445Updated last week
- Generative Representational Instruction Tuning☆562Updated this week
- Automatically evaluate your LLMs in Google Colab☆556Updated 6 months ago
- ReFT: Representation Finetuning for Language Models☆1,145Updated this week
- Official repository for ORPO☆420Updated 5 months ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,042Updated this week
- Automated Evaluation of RAG Systems☆479Updated this week
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,026Updated last week
- A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.☆692Updated last month
- Official repository for "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient and high-quality s…☆476Updated this week
- Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy☆874Updated last week
- RAGChecker: A Fine-grained Framework For Diagnosing RAG☆528Updated last month
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆467Updated 4 months ago
- awesome synthetic (text) datasets☆239Updated last week
- A reading list on LLM based Synthetic Data Generation 🔥☆761Updated this week
- Best practices for distilling large language models.☆392Updated 9 months ago
- DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤☆838Updated 3 months ago
- Framework for enhancing LLMs for RAG tasks using fine-tuning.☆502Updated 3 weeks ago
- Code for Quiet-STaR☆639Updated 2 months ago
- A library for easily merging multiple LLM experts, and efficiently train the merged LLM.☆401Updated 2 months ago
- List of papers on hallucination detection in LLMs.☆669Updated last week
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.☆1,797Updated last week
- LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed by the PAIR t…☆318Updated 3 weeks ago
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆764Updated this week
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆332Updated 2 months ago
- [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…☆286Updated 11 months ago
- An Open Source Toolkit For LLM Distillation☆350Updated last month
- Official repo for the paper "Scaling Synthetic Data Creation with 1,000,000,000 Personas"☆868Updated last month