The official repository for our EMNLP 2024 paper, Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretability.
☆20Feb 23, 2025Updated last year
Alternatives and similar repositories for Themis
Users that are interested in Themis are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- HANNA, a large annotated dataset of Human-ANnotated NArratives for ASG evaluation.☆35Oct 15, 2024Updated last year
- ☆11Nov 21, 2024Updated last year
- ☆13Jun 5, 2024Updated last year
- ☆47Mar 25, 2025Updated last year
- ☆19Feb 24, 2025Updated last year
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆13Apr 21, 2024Updated last year
- Tools to estimate the correlation of different text-based evaluation measures for Automatic Image Description☆10Feb 2, 2017Updated 9 years ago
- Anonymization Pipeline for injesting data from outside of BSC that contains GDPR protected data.☆16Nov 10, 2023Updated 2 years ago
- ☆16Jun 25, 2025Updated 9 months ago
- A fork of HumanEval-Java from the paper "Impact of Code Language Models on Automated Program Repair"☆13Dec 11, 2024Updated last year
- DQN play <2048> game☆12Feb 11, 2021Updated 5 years ago
- FBI: Finding Blindspots in LLM Evaluations with Interpretable Checklists☆31Aug 14, 2025Updated 7 months ago
- An ambiguous subtitles dataset for visual scene-aware machine translation☆14Oct 17, 2022Updated 3 years ago
- Evaluate the Quality of Critique☆36Jun 1, 2024Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆14Aug 30, 2023Updated 2 years ago
- A faster, simpler and distributed implementation of GECToR, a seq2edit GEC model☆16Oct 10, 2022Updated 3 years ago
- [COLING2022] A Multi-turn Machine Reading Comprehension Framework with Rethink Mechanism for Emotion-Cause Pair Extraction☆18Oct 13, 2022Updated 3 years ago
- Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study☆43Mar 8, 2023Updated 3 years ago
- ☆28Feb 20, 2026Updated last month
- Supporting code for the EMNLP 2019 paper "Answers Unite! Unsupervised Metrics for Reinforced Summarization Models"☆14Jun 12, 2023Updated 2 years ago
- The repo for using the model https://huggingface.co/thu-coai/Attacker-v0.1☆13Apr 23, 2025Updated 11 months ago
- A Recipe for Building LLM Reasoners to Solve Complex Instructions☆31Oct 9, 2025Updated 5 months ago
- ☆25May 16, 2024Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆13Nov 7, 2023Updated 2 years ago
- Code for "Goodtriever: Toxicity Mitigation with Retrieval-augmented Language Models"☆25May 30, 2024Updated last year
- Benchmark for evaluating open-ended generation☆51Nov 6, 2024Updated last year
- Global ASP - African Storybook Project for the World☆18Dec 1, 2025Updated 3 months ago
- ☆24Oct 14, 2024Updated last year
- Exchange-of-Thought: Enhancing Large Language Model Capabilities through Cross-Model Communication☆21Mar 21, 2024Updated 2 years ago
- PyTorch implementation of Gaussian word embeddings☆19Apr 7, 2018Updated 7 years ago
- Project for a Computer Security class based on CSAW capture the flag challenges☆13Mar 19, 2014Updated 12 years ago
- The code of paper "Toward Optimal LLM Alignments Using Two-Player Games".☆17Jun 20, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Running inference on the ZeroSCROLLS benchmark☆20Apr 18, 2024Updated last year
- [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following☆137Jul 8, 2024Updated last year
- [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…☆312Nov 11, 2023Updated 2 years ago
- ☆24Apr 2, 2024Updated last year
- 零样本学习测评基准，中文版☆59Jun 23, 2021Updated 4 years ago
- ☆148Jul 1, 2024Updated last year
- ☆22Aug 30, 2021Updated 4 years ago