The official repository for our EMNLP 2024 paper, Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretability.
☆20Feb 23, 2025Updated last year
Alternatives and similar repositories for Themis
Users that are interested in Themis are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- HANNA, a large annotated dataset of Human-ANnotated NArratives for ASG evaluation.☆37Oct 15, 2024Updated last year
- [AAAI 2024] History Matters: Temporal Knowledge Editing in Large Language Model☆13Dec 17, 2023Updated 2 years ago
- [EMNLP 2023] ALCUNA: Large Language Models Meet New Knowledge☆30Oct 30, 2023Updated 2 years ago
- ☆11Nov 21, 2024Updated last year
- ☆13Jun 5, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Easily train your own text-generating neural network of any size and complexity on any text dataset with a few lines of code.☆13Jul 22, 2018Updated 7 years ago
- ☆48Mar 25, 2025Updated last year
- Codes for paper "Stylized Story Generation with Style-Guided Planning"☆12May 9, 2021Updated 5 years ago
- Official code and data of "3AM: An Ambiguity-Aware Multi-Modal Machine Translation Dataset"☆12Dec 8, 2024Updated last year
- ☆15Jan 3, 2015Updated 11 years ago
- ☆21Nov 7, 2024Updated last year
- ☆16Jun 25, 2025Updated 11 months ago
- A fork of HumanEval-Java from the paper "Impact of Code Language Models on Automated Program Repair"☆16Dec 11, 2024Updated last year
- DQN play <2048> game☆12Feb 11, 2021Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Evaluate the Quality of Critique☆37Jun 1, 2024Updated 2 years ago
- ☆14Aug 30, 2023Updated 2 years ago
- [COLING2022] A Multi-turn Machine Reading Comprehension Framework with Rethink Mechanism for Emotion-Cause Pair Extraction☆18Oct 13, 2022Updated 3 years ago
- Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study☆42Mar 8, 2023Updated 3 years ago
- ☆37Feb 20, 2026Updated 3 months ago
- Supporting code for the EMNLP 2019 paper "Answers Unite! Unsupervised Metrics for Reinforced Summarization Models"☆14Jun 12, 2023Updated 3 years ago
- Data and codes for EMNLP 2022 paper "CDConv: A Benchmark for Contradiction Detection in Chinese Conversations"☆13May 8, 2023Updated 3 years ago
- A faster, simpler and distributed implementation of GECToR, a seq2edit GEC model☆16Oct 10, 2022Updated 3 years ago
- ☆11Mar 3, 2026Updated 3 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆25May 16, 2024Updated 2 years ago
- ☆13Nov 7, 2023Updated 2 years ago
- Benchmark for evaluating open-ended generation☆50Nov 6, 2024Updated last year
- ☆24Oct 14, 2024Updated last year
- [NeurIPS 2025] Reasoning Models Better Express Their Confidence"☆23Nov 19, 2025Updated 6 months ago
- Dr.VOT is an a software package for automatic measurement of voice onset time (VOT).☆32Jul 25, 2023Updated 2 years ago
- Exchange-of-Thought: Enhancing Large Language Model Capabilities through Cross-Model Communication☆21Mar 21, 2024Updated 2 years ago
- PyTorch implementation of Gaussian word embeddings☆19Apr 7, 2018Updated 8 years ago
- Code of EMNLP 2025 paper 'UltraIF: Advancing Instruction Following from the Wild'.☆21Apr 3, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆32Sep 6, 2023Updated 2 years ago
- The code of paper "Toward Optimal LLM Alignments Using Two-Player Games".☆17Jun 20, 2024Updated last year
- Running inference on the ZeroSCROLLS benchmark☆22Apr 18, 2024Updated 2 years ago
- [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following☆138Jul 8, 2024Updated last year
- [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…☆321Nov 11, 2023Updated 2 years ago
- ☆24Apr 2, 2024Updated 2 years ago
- 零样本学习测评基准，中文版☆59Jun 23, 2021Updated 4 years ago