Automatic metrics for GEM tasks
☆69Oct 25, 2022Updated 4 years ago
Alternatives and similar repositories for GEM-metrics
Users that are interested in GEM-metrics are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Repro is a library for easily running code from published papers via Docker.☆42Sep 22, 2023Updated 3 years ago
- PERIN is Permutation-Invariant Semantic Parser developed for MRP 2020☆46Aug 26, 2022Updated 4 years ago
- Python 3 support for the MS COCO caption evaluation tools☆14Jun 14, 2024Updated 2 years ago
- ☆10Oct 28, 2024Updated 2 years ago
- The implementation of the paper "Retrieval-Free Knowledge-Grounded Dialogue Response Generation with Adapters".☆17May 24, 2022Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Code for ACL 2022 Paper: Active Evaluation: Efficient NLG Evaluation with Few Pairwise Comparisons☆14Dec 22, 2022Updated 3 years ago
- The dataset and statistical analysis code released with the submission of EMNLP 2017 paper "Why We Need New Evaluation Metrics for NLG"☆19Nov 6, 2026Updated last week
- Data visualization code generation benchmark: Evaluates LLMs' ability to generate visualization code from DataFrame descriptions.☆13Nov 28, 2025Updated 11 months ago
- ☆38May 14, 2024Updated 2 years ago
- ☆22Aug 31, 2021Updated 5 years ago
- ☆30May 20, 2022Updated 4 years ago
- Implementation of ICLR 2020 paper "Revisiting Self-Training for Neural Sequence Generation"☆46Jun 30, 2022Updated 4 years ago
- "Learning Rhyming Constraints using Structured Adversaries. Jhamtani H., Mehta S., Carbonell J., Berg-Kirkpatrick T. EMNLP-IJCNLP (Short …☆11Mar 17, 2020Updated 6 years ago
- Placeholder repository☆15Mar 16, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A benchmark dataset for evaluating dialog system and natural language generation metrics.☆39Jun 13, 2022Updated 4 years ago
- 🤖 Code for our EMNLP 2022 paper: "BotsTalk: Machine-sourced Framework for Automatic Curation of Large-scale Multi-skill Dialogue Dataset…☆16Oct 7, 2024Updated 2 years ago
- ☆19Nov 7, 2023Updated 3 years ago
- Code for TACL 2022 paper on Data-to-text Generation with Variational Sequential Planning☆22Apr 25, 2022Updated 4 years ago
- ☆12Jul 3, 2024Updated 2 years ago
- Consistent dialogue generation☆16Oct 26, 2022Updated 4 years ago
- ☆49Jun 12, 2023Updated 3 years ago
- MultiLexNorm 2021 competition system from ÚFAL☆16Dec 30, 2021Updated 4 years ago
- ☆33Mar 31, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [TACL 2024] Improving Probability-based Prompt Selection Through Unified Evaluation and Analysis☆11Nov 14, 2024Updated 2 years ago
- ☆11Sep 19, 2025Updated last year
- NL-Augmenter 🦎 → 🐍 A Collaborative Repository of Natural Language Transformations☆785May 19, 2024Updated 2 years ago
- Few-shot Learning of GPT-3☆360Sep 18, 2023Updated 3 years ago
- A list of advisory blogs and resources that I have found useful so far.☆22Nov 25, 2020Updated 5 years ago
- Code release for "TempLM: Distilling Language Models into Template-Based Generators"☆14Jul 21, 2022Updated 4 years ago
- A crowdsourced dataset of dialogues grounded in social contexts involving utilization of commonsense.☆80Sep 15, 2021Updated 5 years ago
- DSTC10 Track 2 - Knowledge-grounded Task-oriented Dialogue Modeling on Spoken Conversations☆65Jul 25, 2023Updated 3 years ago
- LLM Training code from our paper **Chart Specification: Structural Representations for Incentivizing VLM Reasoning in Chart-to-Code Gener…☆14Aug 7, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A cost estimator for OpenAI API calls in tqdm loops.☆20Nov 25, 2024Updated last year
- ☆31Jan 16, 2021Updated 5 years ago
- ☆20Sep 17, 2021Updated 5 years ago
- #인권코퍼스☆31Oct 6, 2023Updated 3 years ago
- [EMNLP 2023] Official repository for Dialogue Chain-of-Thought Distillation (DONUT & DOCTOR)☆11Nov 15, 2023Updated 3 years ago
- [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation☆28Dec 9, 2022Updated 3 years ago
- Library for experimenting with state-of-the-art evaluation metrics like UScore☆12May 27, 2023Updated 3 years ago
Are these results useful?