The official repository for our EMNLP 2024 paper, Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretability.
☆22Feb 23, 2025Updated last year
Alternatives and similar repositories for Themis
Users that are interested in Themis are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- HANNA, a large annotated dataset of Human-ANnotated NArratives for ASG evaluation.☆38Oct 15, 2024Updated last year
- [AAAI 2024] History Matters: Temporal Knowledge Editing in Large Language Model☆13Dec 17, 2023Updated 2 years ago
- [EMNLP 2023] ALCUNA: Large Language Models Meet New Knowledge☆30Oct 30, 2023Updated 2 years ago
- ☆48Mar 25, 2025Updated last year
- Official code and data of "3AM: An Ambiguity-Aware Multi-Modal Machine Translation Dataset"☆12Dec 8, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆10Oct 14, 2023Updated 2 years ago
- ☆15Jan 3, 2015Updated 11 years ago
- DQN play <2048> game☆12Feb 11, 2021Updated 5 years ago
- An ambiguous subtitles dataset for visual scene-aware machine translation☆14Oct 17, 2022Updated 3 years ago
- ☆14Aug 30, 2023Updated 2 years ago
- Evaluate the Quality of Critique☆37Jun 1, 2024Updated 2 years ago
- [COLING2022] A Multi-turn Machine Reading Comprehension Framework with Rethink Mechanism for Emotion-Cause Pair Extraction☆18Oct 13, 2022Updated 3 years ago
- A faster, simpler and distributed implementation of GECToR, a seq2edit GEC model☆16Oct 10, 2022Updated 3 years ago
- The repo for using the model https://huggingface.co/thu-coai/Attacker-v0.1☆13Apr 23, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆25May 16, 2024Updated 2 years ago
- Benchmark for evaluating open-ended generation☆50Nov 6, 2024Updated last year
- PyTorch implementation of Gaussian word embeddings☆19Apr 7, 2018Updated 8 years ago
- ☆11Mar 3, 2026Updated 5 months ago
- Exchange-of-Thought: Enhancing Large Language Model Capabilities through Cross-Model Communication☆21Mar 21, 2024Updated 2 years ago
- Your agent is powerful but it doesn't know you. VibeLens visualizes agent sessions, personalizes your agents, provides dashboard analytic…☆19Updated this week
- [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…☆324Nov 11, 2023Updated 2 years ago
- [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following☆139Jul 8, 2024Updated 2 years ago
- ☆24Apr 2, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Project for a Computer Security class based on CSAW capture the flag challenges☆13Mar 19, 2014Updated 12 years ago
- The code of paper "Toward Optimal LLM Alignments Using Two-Player Games".☆17Jun 20, 2024Updated 2 years ago
- 🧨 Vue自学指南！☆12Jun 11, 2021Updated 5 years ago
- A fork of HumanEval-Java from the paper "Impact of Code Language Models on Automated Program Repair"☆21Dec 11, 2024Updated last year
- ☆148Jul 1, 2024Updated 2 years ago
- ☆22Aug 30, 2021Updated 4 years ago
- ☆17Jun 25, 2025Updated last year
- Library for simulating time progression in Python☆16Aug 16, 2025Updated last year
- Data for paper "CC-Riddle: A Question Answering Dataset of Chinese Character Riddles": https://arxiv.org/abs/2206.13778☆21Aug 19, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆14Nov 26, 2020Updated 5 years ago
- SIGIR 2021: Proactive Retrieval-based Chatbots based on Relevant Knowledge and Goals☆11Jul 30, 2021Updated 5 years ago
- New testbed of interactive SWE tasks for coding agents, set in a realistic multi-turn developer driven environment☆24Jun 30, 2026Updated last month
- ☆12Nov 1, 2023Updated 2 years ago
- A Monte Carlo Tree Search AI for the game 2048☆30May 24, 2020Updated 6 years ago
- ☆21Jan 15, 2024Updated 2 years ago
- [ICML 2026] Official implementation for paper "Unsafer in Many Turns: Benchmarking and Defending Multi-Turn Safety Risks in Tool-Using Ag…☆32Jul 31, 2026Updated 2 weeks ago