Code for paper "G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment"
☆419Feb 4, 2024Updated 2 years ago
Alternatives and similar repositories for geval
Users that are interested in geval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation☆217Feb 10, 2024Updated 2 years ago
- Resources for paper "DialSummEval: Revisiting summarization evaluation for dialogues"☆14Jul 22, 2025Updated 9 months ago
- Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study☆43Mar 8, 2023Updated 3 years ago
- BARTScore: Evaluating Generated Text as Text Generation☆369Jun 27, 2022Updated 3 years ago
- ☆23Feb 26, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Evaluate your LLM's response with Prometheus and GPT4 💯☆1,075Apr 25, 2025Updated last year
- [ACL 2025] DICE-BENCH: Evaluating the Tool-Use Capabilities of Large Language Models in Multi-Round, Multi-Party Dialogues☆26Jul 10, 2025Updated 9 months ago
- explainable-machine-translation-metrics☆12Jul 15, 2022Updated 3 years ago
- HANNA, a large annotated dataset of Human-ANnotated NArratives for ASG evaluation.☆36Oct 15, 2024Updated last year
- Benchmark for evaluating open-ended generation☆51Nov 6, 2024Updated last year
- BERT score for text generation☆1,891Jul 30, 2024Updated last year
- [ACL 2024] FLEUR: An Explainable Reference-Free Evaluation Metric for Image Captioning Using a Large Multimodal Model☆17Apr 28, 2025Updated last year
- ☆144Sep 10, 2023Updated 2 years ago
- Implementation of EMNLP 2023 Findings: Improving Question Generation with Multi-level Content Planning☆18Nov 30, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆610Jun 26, 2024Updated last year
- First explanation metric (diagnostic report) for text generation evaluation☆62Mar 3, 2025Updated last year
- Data and code for EMNLP 2023 industry-track paper "Investigating Table-to-Text Generation Capabilities of Large Language Models in Real-W…☆31Jan 5, 2024Updated 2 years ago
- Resources for the "SummEval: Re-evaluating Summarization Evaluation" paper☆415Jun 23, 2024Updated last year
- The LLM Evaluation Framework☆15,111May 1, 2026Updated last week
- Hugging Face and Pyserini interoperability☆19May 18, 2023Updated 2 years ago
- ☆104Mar 4, 2024Updated 2 years ago
- ☆13Nov 7, 2023Updated 2 years ago
- Forked repo from https://github.com/EleutherAI/lm-evaluation-harness/commit/1f66adc☆81Feb 28, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- The Official Repository for the Automatic Dialogue Evaluation Sub-task of DSTC10 Track 5 (Automatic Evaluation and Moderation of Open-dom…☆19Nov 1, 2021Updated 4 years ago
- [ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets☆218Dec 24, 2023Updated 2 years ago
- Automated Evaluation of RAG Systems☆709Mar 28, 2025Updated last year
- LangChain / LangGraph Q&A 에이전트☆35Apr 15, 2025Updated last year
- AutoRAG example about benchmarking Korean embeddings.☆44Oct 2, 2024Updated last year
- Scalable Meta-Evaluation of LLMs as Evaluators☆43Feb 15, 2024Updated 2 years ago
- Code for EMNLP 2023 findings paper "A Closer Look into Using Large Language Models for Automatic Evaluation"☆19Oct 9, 2023Updated 2 years ago
- One implementation of the paper "Coreference-Aware Dialogue Summarization".☆19Nov 9, 2023Updated 2 years ago
- [NAACL 2025] ETHIC: Evaluating Large Language Models on Long-Context Tasks with High Information Coverage☆16Sep 2, 2025Updated 8 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Codebase, data and models for the SummaC paper in TACL☆109Jan 30, 2025Updated last year
- MCP Atlas☆76Updated this week
- The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".☆1,602Apr 17, 2026Updated 3 weeks ago
- ☆45Oct 14, 2021Updated 4 years ago
- [EMNLP 2023] Enabling Large Language Models to Generate Text with Citations. Paper: https://arxiv.org/abs/2305.14627☆514Oct 9, 2024Updated last year
- ☆11Aug 26, 2021Updated 4 years ago
- A framework for few-shot evaluation of language models.☆12,411Apr 30, 2026Updated last week