[ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues
☆154Jul 24, 2024Updated 2 years ago
Alternatives and similar repositories for mt-bench-101
Users that are interested in mt-bench-101 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, …☆19Jun 25, 2024Updated 2 years ago
- Code and data for "MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models"☆58Nov 18, 2025Updated 11 months ago
- Evaluating LLMs' multi-round chatting capability via assessing conversations generated by two LLM instances.☆163May 22, 2025Updated last year
- Official repository for paper "Can Language Models Follow Multiple Turns of Entangled Instructions?"☆13Sep 20, 2025Updated last year
- [ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models☆121Jun 12, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- This is the official GitHub repository for our survey paper "Beyond Single-Turn: A Survey on Multi-Turn Interactions with Large Language …☆213Jul 11, 2026Updated 3 months ago
- [ACL 2024 Findings] The official repo for "ConceptMath: A Bilingual Concept-wise Benchmark for Measuring Mathematical Reasoning of Large …☆26May 29, 2024Updated 2 years ago
- [KDD 2025] AtomR: Atomic Operator-Empowered Large Language Models for Heterogeneous Knowledge Reasoning☆15May 27, 2025Updated last year
- Codes for paper: "LaMP-QA: A Benchmark for Personalized Long-form Question Answering"☆13Jun 3, 2025Updated last year
- ICLR 206☆14Aug 18, 2026Updated 2 months ago
- Arena-Hard-Auto: An automatic LLM benchmark.☆1,086Jun 21, 2025Updated last year
- AAAI'26, AP2O-Coder: Adaptively Progressive Preference Optimization for Reducing Compilation and Runtime Errors in LLM-Generated Code☆14Jan 16, 2026Updated 9 months ago
- CFBench: A Comprehensive Constraints-Following Benchmark for LLMs☆57Aug 26, 2024Updated 2 years ago
- ☆100Feb 5, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- [NeurIPS 2025] Reasoning Models Better Express Their Confidence"☆23Nov 19, 2025Updated 11 months ago
- An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.☆2,021Aug 9, 2025Updated last year
- The evaluation code for MultiIF multi-turn and multi-lingual instruction following☆63Oct 29, 2024Updated 2 years ago
- ☆148Sep 10, 2023Updated 3 years ago
- RewardBench: the first evaluation tool for reward models.☆748Oct 14, 2026Updated 2 weeks ago
- An Open-Source Package for Neural Relation Extraction (NRE)☆19Aug 24, 2021Updated 5 years ago
- ☆62Aug 22, 2024Updated 2 years ago
- FORTE (Full-cycle Office Real-world Task Evaluation) is a general agent benchmark for evaluating AI agents on daily office productivity a…☆20Jun 30, 2026Updated 4 months ago
- An arxiv spider☆13Oct 27, 2021Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆10Jun 15, 2024Updated 2 years ago
- ☆19Sep 5, 2026Updated last month
- ☆17May 31, 2023Updated 3 years ago
- ☆16Sep 4, 2023Updated 3 years ago
- ☆30Dec 27, 2024Updated last year
- Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…☆145Jun 4, 2024Updated 2 years ago
- A spoken version of the textual story cloze benchmark☆22Aug 6, 2023Updated 3 years ago
- ☆48Mar 25, 2025Updated last year
- Through RL training, stimulate the reflective capabilities of the prover model.☆12Apr 17, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- SG-Bench: Evaluating LLM Safety Generalization Across Diverse Tasks and Prompt Types☆26Nov 29, 2024Updated last year
- [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following☆143Jul 8, 2024Updated 2 years ago
- ☆12May 11, 2025Updated last year
- Evaluate gpt-4o on CLIcK (Korean NLP Dataset)☆20May 18, 2024Updated 2 years ago
- Source code of paper "Systematic Assessment of Factual Knowledge in Large Language Models" - EMNLP Findings 2023☆19Mar 17, 2026Updated 7 months ago
- The repo for using the model https://huggingface.co/thu-coai/Attacker-v0.1☆13Apr 23, 2025Updated last year
- Flames is a highly adversarial benchmark in Chinese for LLM's harmlessness evaluation developed by Shanghai AI Lab and Fudan NLP Group.☆68May 21, 2024Updated 2 years ago