HLTCHKUST / chatgpt-evaluation
This respository contains the code for extracting the test samples we used in our paper: "A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity"
☆77Updated 11 months ago
Related projects ⓘ
Alternatives and complementary repositories for chatgpt-evaluation
- ☆36Updated 7 months ago
- This project maintains a reading list for general text generation tasks☆65Updated 2 years ago
- Paper list of "The Life Cycle of Knowledge in Big Language Models: A Survey"☆61Updated last year
- ☆59Updated last year
- EMNLP'2022: BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation☆38Updated 2 years ago
- [EMNLP 2023] C-STS: Conditional Semantic Textual Similarity☆66Updated 5 months ago
- domain adaptation in NLP☆53Updated 3 years ago
- ☆43Updated 6 months ago
- TBC☆26Updated 2 years ago
- ☆78Updated last year
- Code for Editing Factual Knowledge in Language Models☆135Updated 2 years ago
- ☆116Updated 2 years ago
- First explanation metric (diagnostic report) for text generation evaluation☆60Updated 3 months ago
- ConTextual Mask Auto-Encoder for Dense Passage Retrieval☆35Updated this week
- [NLPCC 2022] Kformer: Knowledge Injection in Transformer Feed-Forward Layers☆35Updated 2 years ago
- ⚡Research papers about leveraging the capabilities of language models⚡☆52Updated last year
- Lexically constrained text generation with CBART.☆47Updated 2 years ago
- Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study☆42Updated last year
- [NeurIPS'22 Spotlight] Data and code for our paper CoNT: Contrastive Neural Text Generation☆150Updated last year
- [NeurIPS 2022] Generating Training Data with Language Models: Towards Zero-Shot Language Understanding☆63Updated 2 years ago
- [EMNLP 2022] Code and data for "Controllable Dialogue Simulation with In-Context Learning"☆34Updated last year
- ☆78Updated 2 years ago
- 🩺 A collection of ChatGPT evaluation reports on various bechmarks.☆48Updated last year
- Interpretable unified language safety checking with large language models☆30Updated last year
- ☆80Updated last year
- A toolkit for evaluation of natural language generation (NLG), including BLEU, ROUGE, METEOR, and CIDEr.☆31Updated 4 years ago
- Do Large Language Models Know What They Don’t Know?☆85Updated this week
- ☆32Updated 2 years ago
- We construct and introduce DIALFACT, a testing benchmark dataset crowd-annotated conversational claims, paired with pieces of evidence fr…☆41Updated 2 years ago
- Repo for paper: Controllable Text Generation with Language Constraints☆19Updated last year