PKU-ONELab / Themis
The official repository for our NLG evaluation LLM Themis and the paper Themis: Towards Flexible and Interpretable NLG Evaluation.
☆16Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for Themis
- 🩺 A collection of ChatGPT evaluation reports on various bechmarks.☆48Updated last year
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆46Updated 4 months ago
- First explanation metric (diagnostic report) for text generation evaluation☆60Updated 4 months ago
- Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study☆42Updated last year
- Towards Systematic Measurement for Long Text Quality☆28Updated 2 months ago
- ☆47Updated 2 months ago
- This project maintains a reading list for general text generation tasks☆65Updated 2 years ago
- Repo for "On Learning to Summarize with Large Language Models as References"☆42Updated last year
- ☆16Updated 8 months ago
- GPT as Human☆18Updated 9 months ago
- An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).☆42Updated 3 months ago
- [EMNLP 2023] ALCUNA: Large Language Models Meet New Knowledge☆25Updated last year
- ☆35Updated last year
- The code implementation of the EMNLP2022 paper: DisCup: Discriminator Cooperative Unlikelihood Prompt-tuning for Controllable Text Gene…☆25Updated last year
- Code and dataset for the emnlp paper titled Instruct and Extract: Instruction Tuning for On-Demand Information Extraction☆49Updated 10 months ago
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆36Updated 8 months ago
- [ICML'2024] Can AI Assistants Know What They Don't Know?☆70Updated 9 months ago
- Code for M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models☆22Updated 3 months ago
- Code base of In-Context Learning for Dialogue State tracking☆44Updated last year
- Collection of papers for scalable automated alignment.☆72Updated 3 weeks ago
- ☆23Updated last year
- Exchange-of-Thought: Enhancing Large Language Model Capabilities through Cross-Model Communication☆16Updated 7 months ago
- Code and data for "MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models"☆30Updated 3 weeks ago
- Detect hallucinated tokens for conditional sequence generation.☆63Updated 2 years ago
- The LM Contamination Index is a manually created database of contamination evidences for LMs.☆75Updated 7 months ago
- Implementation of "Investigating the Factual Knowledge Boundary of Large Language Models with Retrieval Augmentation"☆77Updated last year
- PyTorch code for EMNLP 2021 paper: Don't be Contradicted with Anything! CI-ToD: Towards Benchmarking Consistency for Task-oriented Dialog…☆27Updated 3 years ago
- On Transferability of Prompt Tuning for Natural Language Processing☆97Updated 6 months ago
- Code and data for paper "Context-faithful Prompting for Large Language Models".☆39Updated last year
- Source codes and datasets for How well do Large Language Models perform in Arithmetic tasks?☆57Updated last year