Automatic metrics for GEM tasks
☆69Oct 25, 2022Updated 4 years ago
Alternatives and similar repositories for GEM-metrics
Users that are interested in GEM-metrics are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PERIN is Permutation-Invariant Semantic Parser developed for MRP 2020☆46Aug 26, 2022Updated 4 years ago
- Repro is a library for easily running code from published papers via Docker.☆42Sep 22, 2023Updated 3 years ago
- The implementation of the paper "Retrieval-Free Knowledge-Grounded Dialogue Response Generation with Adapters".☆17May 24, 2022Updated 4 years ago
- ☆10Oct 28, 2024Updated 2 years ago
- Code for ACL 2022 Paper: Active Evaluation: Efficient NLG Evaluation with Few Pairwise Comparisons☆14Dec 22, 2022Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The dataset and statistical analysis code released with the submission of EMNLP 2017 paper "Why We Need New Evaluation Metrics for NLG"☆19Nov 16, 2021Updated 4 years ago
- ☆38May 14, 2024Updated 2 years ago
- ☆22Aug 31, 2021Updated 5 years ago
- ☆30May 20, 2022Updated 4 years ago
- Implementation of ICLR 2020 paper "Revisiting Self-Training for Neural Sequence Generation"☆46Jun 30, 2022Updated 4 years ago
- A benchmark dataset for evaluating dialog system and natural language generation metrics.☆39Jun 13, 2022Updated 4 years ago
- ☆19Nov 7, 2023Updated 2 years ago
- 🤖 Code for our EMNLP 2022 paper: "BotsTalk: Machine-sourced Framework for Automatic Curation of Large-scale Multi-skill Dialogue Dataset…☆16Oct 7, 2024Updated 2 years ago
- ☆33Mar 31, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Consistent dialogue generation☆16Oct 26, 2022Updated 4 years ago
- [TACL 2024] Improving Probability-based Prompt Selection Through Unified Evaluation and Analysis☆11Nov 14, 2024Updated last year
- ☆11Sep 19, 2025Updated last year
- NL-Augmenter 🦎 → 🐍 A Collaborative Repository of Natural Language Transformations☆785May 19, 2024Updated 2 years ago
- Code release for "TempLM: Distilling Language Models into Template-Based Generators"☆14Jul 21, 2022Updated 4 years ago
- Few-shot Learning of GPT-3☆360Sep 18, 2023Updated 3 years ago
- A list of advisory blogs and resources that I have found useful so far.☆22Nov 25, 2020Updated 5 years ago
- Repository for "K-BrowseComp: A Web Browsing Agent Benchmark Grounded in Korean Contexts"☆16Jun 2, 2026Updated 4 months ago
- DSTC10 Track 2 - Knowledge-grounded Task-oriented Dialogue Modeling on Spoken Conversations☆64Jul 25, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆42Mar 8, 2021Updated 5 years ago
- A crowdsourced dataset of dialogues grounded in social contexts involving utilization of commonsense.☆80Sep 15, 2021Updated 5 years ago
- ☆31Jan 16, 2021Updated 5 years ago
- A cost estimator for OpenAI API calls in tqdm loops.☆20Nov 25, 2024Updated last year
- ☆16Jun 13, 2017Updated 9 years ago
- ☆20Sep 17, 2021Updated 5 years ago
- #인권코퍼스☆31Oct 6, 2023Updated 3 years ago
- [EMNLP 2023] Official repository for Dialogue Chain-of-Thought Distillation (DONUT & DOCTOR)☆11Nov 15, 2023Updated 2 years ago
- [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation☆28Dec 9, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆18Feb 14, 2018Updated 8 years ago
- Library for experimenting with state-of-the-art evaluation metrics like UScore☆12May 27, 2023Updated 3 years ago
- PERFECT: Prompt-free and Efficient Few-shot Learning with Language Models☆106Dec 16, 2025Updated 10 months ago
- explainable-machine-translation-metrics☆12Jul 15, 2022Updated 4 years ago
- This repository contains the source code and links to some datasets used in the CoNLL 2019 paper "Learning to Represent Bilingual Diction…☆12Oct 1, 2020Updated 6 years ago
- doc2dial data includes a set of documents from multiple domains; and conversations between an assisting agent and an end user that are gr…☆42Jan 8, 2022Updated 4 years ago
- A modular RL library to fine-tune language models to human preferences☆2,397Mar 1, 2024Updated 2 years ago