HLTCHKUST / chatgpt-evaluationLinks
This respository contains the code for extracting the test samples we used in our paper: "A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity"
☆77Updated last year
Alternatives and similar repositories for chatgpt-evaluation
Users that are interested in chatgpt-evaluation are comparing it to the libraries listed below
Sorting:
- This project maintains a reading list for general text generation tasks☆65Updated 3 years ago
- Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study☆43Updated 2 years ago
- ☆36Updated last year
- [COLING22] An End-to-End Library for Evaluating Natural Language Generation☆92Updated last year
- [NeurIPS 2022] Generating Training Data with Language Models: Towards Zero-Shot Language Understanding☆67Updated 2 years ago
- ☆117Updated 3 years ago
- EMNLP'2022: BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation☆41Updated 2 years ago
- [EMNLP 2022] Code and data for "Controllable Dialogue Simulation with In-Context Learning"☆35Updated 2 years ago
- An Interpretable Neuro-Symbolic Framework for Task-Oriented Dialogue Generation☆24Updated 3 years ago
- First explanation metric (diagnostic report) for text generation evaluation☆62Updated 4 months ago
- ☆64Updated 2 years ago
- Code for the paper Code for the paper InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning☆100Updated 2 years ago
- ☆67Updated 3 years ago
- [NeurIPS'22 Spotlight] Data and code for our paper CoNT: Contrastive Neural Text Generation☆153Updated 2 years ago
- domain adaptation in NLP☆53Updated 3 years ago
- Official Code for "PPT: Pre-trained Prompt Tuning for Few-shot Learning". ACL 2022☆108Updated 2 years ago
- Code for Editing Factual Knowledge in Language Models☆138Updated 3 years ago
- Lexically constrained text generation with CBART.☆49Updated 2 years ago
- GIFT (ACL 2023) & MPC-BERT (ACL 2021) for Multi-Party Conversation Understanding☆41Updated 2 years ago
- ☆86Updated 2 years ago
- [EMNLP 2022] Training Language Models with Memory Augmentation https://arxiv.org/abs/2205.12674☆196Updated 2 years ago
- 🩺 A collection of ChatGPT evaluation reports on various bechmarks.☆49Updated 2 years ago
- [EMNLP 2023] C-STS: Conditional Semantic Textual Similarity