Code for paper "G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment"
☆409Feb 4, 2024Updated 2 years ago
Alternatives and similar repositories for geval
Users that are interested in geval are comparing it to the libraries listed below
Sorting:
- Source Code of Paper "GPTScore: Evaluate as You Desire"☆258Feb 21, 2023Updated 3 years ago
- Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation☆215Feb 10, 2024Updated 2 years ago
- Resources for paper "DialSummEval: Revisiting summarization evaluation for dialogues"☆15Jul 22, 2025Updated 7 months ago
- Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study☆43Mar 8, 2023Updated 2 years ago
- BARTScore: Evaluating Generated Text as Text Generation☆367Jun 27, 2022Updated 3 years ago
- ☆22Feb 26, 2024Updated 2 years ago
- [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…☆311Nov 11, 2023Updated 2 years ago
- Evaluate your LLM's response with Prometheus and GPT4 💯☆1,046Apr 25, 2025Updated 10 months ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆43Feb 15, 2024Updated 2 years ago
- HANNA, a large annotated dataset of Human-ANnotated NArratives for ASG evaluation.☆35Oct 15, 2024Updated last year
- Benchmark for evaluating open-ended generation☆50Nov 6, 2024Updated last year
- explainable-machine-translation-metrics☆12Jul 15, 2022Updated 3 years ago
- BERT score for text generation☆1,876Jul 30, 2024Updated last year
- ☆144Sep 10, 2023Updated 2 years ago
- ☆27May 20, 2025Updated 9 months ago
- ☆103Mar 4, 2024Updated last year
- Supercharge Your LLM Application Evaluations 🚀☆12,736Feb 24, 2026Updated last week
- Dataset for NAACL 2021 paper: "QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization"☆143Aug 29, 2023Updated 2 years ago
- Resources for the "SummEval: Re-evaluating Summarization Evaluation" paper☆411Jun 23, 2024Updated last year
- First explanation metric (diagnostic report) for text generation evaluation☆62Mar 3, 2025Updated last year
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆602Jun 26, 2024Updated last year
- [ACL 2024] FLEUR: An Explainable Reference-Free Evaluation Metric for Image Captioning Using a Large Multimodal Model☆17Apr 28, 2025Updated 10 months ago
- Forked repo from https://github.com/EleutherAI/lm-evaluation-harness/commit/1f66adc☆82Feb 28, 2024Updated 2 years ago
- Automated Evaluation of RAG Systems☆695Mar 28, 2025Updated 11 months ago
- The LLM Evaluation Framework☆13,787Feb 23, 2026Updated last week
- Implementation of EMNLP 2023 Findings: Improving Question Generation with Multi-level Content Planning☆18Nov 30, 2023Updated 2 years ago
- ✨✨Latest Papers about LLM-based Evaluators☆31Updated this week
- 🤗 Evaluate: A library for easily evaluating machine learning models and datasets.☆2,419Jan 20, 2026Updated last month
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,314Feb 20, 2026Updated last week
- The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".☆1,589Jun 3, 2025Updated 9 months ago
- Data and code for EMNLP 2023 industry-track paper "Investigating Table-to-Text Generation Capabilities of Large Language Models in Real-W…☆30Jan 5, 2024Updated 2 years ago
- Open sourced backend for Martian's LLM Inference Provider Leaderboard☆21Aug 13, 2024Updated last year
- Hugging Face and Pyserini interoperability☆19May 18, 2023Updated 2 years ago
- [EMNLP 2023] Enabling Large Language Models to Generate Text with Citations. Paper: https://arxiv.org/abs/2305.14627☆511Oct 9, 2024Updated last year
- A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…☆415Apr 13, 2025Updated 10 months ago
- A framework for few-shot evaluation of language models.☆11,478Feb 15, 2026Updated 2 weeks ago
- One implementation of the paper "Coreference-Aware Dialogue Summarization".☆19Nov 9, 2023Updated 2 years ago
- ☆39Jun 7, 2023Updated 2 years ago
- [ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets☆217Dec 24, 2023Updated 2 years ago