prometheus-eval / prometheus-eval
Evaluate your LLM's response with Prometheus and GPT4 💯
☆797Updated 2 months ago
Related projects ⓘ
Alternatives and complementary repositories for prometheus-eval
- ☆451Updated 3 weeks ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆1,634Updated this week
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆811Updated this week
- Generative Representational Instruction Tuning☆567Updated this week
- Automatically evaluate your LLMs in Google Colab☆559Updated 6 months ago
- A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.☆700Updated 2 months ago
- ReFT: Representation Finetuning for Language Models☆1,159Updated 2 weeks ago
- Official repository for ORPO☆421Updated 5 months ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,095Updated last week
- RAGChecker: A Fine-grained Framework For Diagnosing RAG☆542Updated last month
- Automated Evaluation of RAG Systems☆484Updated 2 weeks ago
- Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy☆899Updated last week
- Official repository for "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient and high-quality s…☆491Updated 2 weeks ago
- Official repo for the paper "Scaling Synthetic Data Creation with 1,000,000,000 Personas"☆883Updated last month
- awesome synthetic (text) datasets☆242Updated 3 weeks ago
- Framework for enhancing LLMs for RAG tasks using fine-tuning.☆504Updated this week
- Code for Quiet-STaR☆651Updated 3 months ago
- The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval☆966Updated 2 months ago
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,045Updated this week
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆1,565Updated 3 months ago
- A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).☆744Updated this week
- [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning☆613Updated 5 months ago
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆471Updated 4 months ago
- Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"☆448Updated 8 months ago
- Code for Husky, an open-source language agent that solves complex, multi-step reasoning tasks. Husky v1 addresses numerical, tabular and …☆328Updated 5 months ago
- A reading list on LLM based Synthetic Data Generation 🔥☆791Updated 2 weeks ago
- List of papers on hallucination detection in LLMs.☆678Updated 2 weeks ago
- MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering☆517Updated 2 weeks ago
- Extend existing LLMs way beyond the original training length with constant memory usage, without retraining☆675Updated 7 months ago
- The code used to train and run inference with the ColPali architecture.☆1,132Updated this week