Code for paper "G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment"
☆411Feb 4, 2024Updated 2 years ago
Alternatives and similar repositories for geval
Users that are interested in geval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Source Code of Paper "GPTScore: Evaluate as You Desire"☆259Feb 21, 2023Updated 3 years ago
- Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation☆216Feb 10, 2024Updated 2 years ago
- Resources for paper "DialSummEval: Revisiting summarization evaluation for dialogues"☆15Jul 22, 2025Updated 8 months ago
- Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study☆43Mar 8, 2023Updated 3 years ago
- BARTScore: Evaluating Generated Text as Text Generation☆367Jun 27, 2022Updated 3 years ago
- ☆22Feb 26, 2024Updated 2 years ago
- [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…☆312Nov 11, 2023Updated 2 years ago
- Evaluate your LLM's response with Prometheus and GPT4 💯☆1,057Apr 25, 2025Updated 10 months ago
- [ACL 2025] DICE-BENCH: Evaluating the Tool-Use Capabilities of Large Language Models in Multi-Round, Multi-Party Dialogues☆26Jul 10, 2025Updated 8 months ago
- explainable-machine-translation-metrics☆12Jul 15, 2022Updated 3 years ago
- HANNA, a large annotated dataset of Human-ANnotated NArratives for ASG evaluation.☆35Oct 15, 2024Updated last year
- Benchmark for evaluating open-ended generation☆51Nov 6, 2024Updated last year
- BERT score for text generation☆1,882Jul 30, 2024Updated last year
- [ACL 2024] FLEUR: An Explainable Reference-Free Evaluation Metric for Image Captioning Using a Large Multimodal Model☆17Apr 28, 2025Updated 10 months ago
- ☆144Sep 10, 2023Updated 2 years ago
- Supercharge Your LLM Application Evaluations 🚀☆13,008Feb 24, 2026Updated last month
- Implementation of EMNLP 2023 Findings: Improving Question Generation with Multi-level Content Planning☆18Nov 30, 2023Updated 2 years ago
- Kor-IR: Korean Information Retrieval Benchmark☆17Jul 3, 2024Updated last year
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆606Jun 26, 2024Updated last year
- Resources for the "SummEval: Re-evaluating Summarization Evaluation" paper☆412Jun 23, 2024Updated last year
- Data and code for EMNLP 2023 industry-track paper "Investigating Table-to-Text Generation Capabilities of Large Language Models in Real-W…☆30Jan 5, 2024Updated 2 years ago
- The LLM Evaluation Framework☆14,227Updated this week
- Hugging Face and Pyserini interoperability☆19May 18, 2023Updated 2 years ago
- ☆103Mar 4, 2024Updated 2 years ago
- ☆13Nov 7, 2023Updated 2 years ago
- Forked repo from https://github.com/EleutherAI/lm-evaluation-harness/commit/1f66adc☆82Feb 28, 2024Updated 2 years ago
- The Official Repository for the Automatic Dialogue Evaluation Sub-task of DSTC10 Track 5 (Automatic Evaluation and Moderation of Open-dom…☆19Nov 1, 2021Updated 4 years ago
- ☆13Sep 8, 2024Updated last year
- [ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets☆217Dec 24, 2023Updated 2 years ago
- Automated Evaluation of RAG Systems☆699Mar 28, 2025Updated 11 months ago
- AutoRAG example about benchmarking Korean embeddings.☆43Oct 2, 2024Updated last year
- This repository includes the implementation and results of the paper "ChatGPT is fun, but it is not funny! Humor is still challenging Lar…☆13Jul 13, 2023Updated 2 years ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆43Feb 15, 2024Updated 2 years ago
- LangChain / LangGraph Q&A 에이전트☆35Apr 15, 2025Updated 11 months ago
- Code for EMNLP 2023 findings paper "A Closer Look into Using Large Language Models for Automatic Evaluation"☆19Oct 9, 2023Updated 2 years ago
- One implementation of the paper "Coreference-Aware Dialogue Summarization".☆19Nov 9, 2023Updated 2 years ago
- [NAACL 2025] ETHIC: Evaluating Large Language Models on Long-Context Tasks with High Information Coverage☆16Sep 2, 2025Updated 6 months ago
- ☆10Aug 21, 2021Updated 4 years ago
- MCP Atlas☆50Updated this week