Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study
☆43Mar 8, 2023Updated 3 years ago
Alternatives and similar repositories for chatgpt_as_nlg_evaluator
Users that are interested in chatgpt_as_nlg_evaluator are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Source Code of Paper "GPTScore: Evaluate as You Desire"☆259Feb 21, 2023Updated 3 years ago
- The code and data for "Summary-Oriented Vision Modeling for Multimodal Abstractive Summarization"☆11May 16, 2023Updated 3 years ago
- AMI Meeting Parallel Corpus☆13Dec 11, 2020Updated 5 years ago
- Benchmark for evaluating open-ended generation☆50Nov 6, 2024Updated last year
- The implementation of the paper "Retrieval-Free Knowledge-Grounded Dialogue Response Generation with Adapters".☆17May 24, 2022Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Implementation of DTMT with incremental decoding☆13Feb 20, 2021Updated 5 years ago
- ☆36May 31, 2019Updated 7 years ago
- A benchmark dataset for evaluating dialog system and natural language generation metrics.☆39Jun 13, 2022Updated 4 years ago
- HANNA, a large annotated dataset of Human-ANnotated NArratives for ASG evaluation.☆38Oct 15, 2024Updated last year
- Script for generating the rotowire-modified dataset (Iso et al; ACL 2019)☆12Sep 19, 2021Updated 5 years ago
- Code for the ACL2022 main conference paper "A Variational Hierarchical Model for Neural Cross-Lingual Summarization"☆18Sep 5, 2022Updated 4 years ago
- GEMBA — GPT Estimation Metric Based Assessment☆156Dec 15, 2025Updated 9 months ago
- 🩺 A collection of ChatGPT evaluation reports on various bechmarks.☆50Mar 28, 2023Updated 3 years ago
- ☆21Jan 15, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ACL2023 - AlignScore, a metric for factual consistency evaluation.☆174Mar 11, 2024Updated 2 years ago
- [EMNLP 2022] Code and data for "Controllable Dialogue Simulation with In-Context Learning"☆33Feb 22, 2023Updated 3 years ago
- [ACL 2023] The code for our ACL'23 paper Cold-Start Data Selection for Few-shot Language Model Fine-tuning: A Prompt-Based Uncertainty Pr…☆24Jun 1, 2024Updated 2 years ago
- Code for paper "G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment"☆429Feb 4, 2024Updated 2 years ago
- WSDM‘2022: Knowledge Enhanced Sports Game Summarization☆17Jun 16, 2022Updated 4 years ago
- Language Understanding Augmentation Toolkit for Robustness Testing☆20Jan 22, 2023Updated 3 years ago
- Code for "Think Natively: Unlocking Multilingual Reasoning with Consistency-Enhanced Reinforcement Learning".☆28Nov 11, 2025Updated 10 months ago
- [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"☆53Sep 21, 2023Updated 3 years ago
- Complexity Based Prompting for Multi-Step Reasoning☆17Mar 10, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation☆216Feb 10, 2024Updated 2 years ago
- ☆35Jun 12, 2022Updated 4 years ago
- Code for WikiAsp: Multi-document aspect-based summarization.☆43Dec 9, 2020Updated 5 years ago
- Materials for "Quantifying the Plausibility of Context Reliance in Neural Machine Translation" at ICLR'24 🐑 🐑☆16Apr 18, 2024Updated 2 years ago
- ☆18May 13, 2021Updated 5 years ago
- A method for evaluating the high-level coherence of machine-generated texts. Identifies high-level coherence issues in transformer-based …☆12Mar 18, 2023Updated 3 years ago
- ☆31Apr 21, 2023Updated 3 years ago
- The official repository for our EMNLP 2024 paper, Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretab…☆22Feb 23, 2025Updated last year
- ☆25Dec 7, 2022Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- XWikisCorpus, cross-lingual summarisation, multi-lingual summarisation, pre-trained language models, zero-shot and few-shot summarisation…☆10Nov 4, 2022Updated 3 years ago
- Repo for ACL2023 paper "Won't Get Fooled Again: Answering Questions with False Premises"☆23Jun 11, 2023Updated 3 years ago
- Implementation of Variational Hierarchical User-based Conversation Model☆10Jul 2, 2021Updated 5 years ago
- A sports game summarization dataset in Chinese.☆10Oct 26, 2020Updated 5 years ago
- In-Context Learning User Simulators for Task-Oriented Dialog Systems☆29Jun 2, 2023Updated 3 years ago
- memory-efficient fine-tuning; support 24G GPU memory fine-tuning 7B☆21May 26, 2024Updated 2 years ago
- Fine grained Empathy Direction Detection☆16Dec 11, 2020Updated 5 years ago