prometheus-eval / prometheus-eval
Evaluate your LLM's response with Prometheus and GPT4 💯
☆877Updated last month
Alternatives and similar repositories for prometheus-eval:
Users that are interested in prometheus-eval are comparing it to the libraries listed below
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,238Updated this week
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,517Updated this week
- ☆498Updated 3 months ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,314Updated last week
- Automatically evaluate your LLMs in Google Colab☆593Updated 9 months ago
- Automated Evaluation of RAG Systems☆554Updated 3 months ago
- Official repository for ORPO☆441Updated 9 months ago
- Official repository for ICLR 2025 paper "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient an…☆638Updated 2 weeks ago
- Generative Representational Instruction Tuning☆599Updated last month
- Official repo for the paper "Scaling Synthetic Data Creation with 1,000,000,000 Personas"☆1,048Updated last week
- DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤☆973Updated last month
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆497Updated 8 months ago
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,261Updated 2 weeks ago
- A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.☆743Updated this week
- Stanford NLP Python library for Representation Finetuning (ReFT)☆1,431Updated 3 weeks ago
- Chat Templates for 🤗 HuggingFace Large Language Models☆619Updated 2 months ago
- A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).☆808Updated this week
- An Open Source Toolkit For LLM Distillation☆516Updated last month
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆1,730Updated 6 months ago
- A library for easily merging multiple LLM experts, and efficiently train the merged LLM.☆445Updated 6 months ago
- Best practices for distilling large language models.☆491Updated last year
- Code for Quiet-STaR☆716Updated 6 months ago
- ☆1,006Updated 2 months ago
- A reading list on LLM based Synthetic Data Generation 🔥☆1,176Updated last week
- Train Models Contrastively in Pytorch☆652Updated last week
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆349Updated 5 months ago
- ☆815Updated 5 months ago
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.☆2,110Updated this week
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆1,049Updated last month
- ☆366Updated last month