Evaluating LLMs' multi-round chatting capability via assessing conversations generated by two LLM instances.
☆162May 22, 2025Updated 11 months ago
Alternatives and similar repositories for BotChat
Users that are interested in BotChat are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code and data for "MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models"☆54Nov 18, 2025Updated 6 months ago
- [ACL 2024 Findings] MathBench: A Comprehensive Multi-Level Difficulty Mathematics Evaluation Dataset☆114May 22, 2025Updated 11 months ago
- The official implementation of "Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks"☆56May 22, 2025Updated 11 months ago
- A Dataset for Multi-Turn Dialogue Reasoning☆334Oct 7, 2020Updated 5 years ago
- [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues☆149Jul 24, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆16Oct 21, 2024Updated last year
- This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"☆17Feb 22, 2024Updated 2 years ago
- ☆58Nov 1, 2021Updated 4 years ago
- Generative Judge for Evaluating Alignment☆250Jan 18, 2024Updated 2 years ago
- [NeurIPS 2024] A comprehensive benchmark for evaluating critique ability of LLMs☆49Nov 29, 2024Updated last year
- Official Repo of "MMBench: Is Your Multi-modal Model an All-around Player?"☆300May 22, 2025Updated 11 months ago
- Code for ACL 2021 paper "Unsupervised Out-of-Domain Detection via Pre-trained Transformers"☆30Aug 20, 2021Updated 4 years ago
- 1st solution for the Webly-supervised Fine-grained Recognition competition in https://www.cvmart.net/race/10412/base☆43Mar 8, 2023Updated 3 years ago
- Assessing Context-Aware Creative Intelligence in MLLMs☆23Jul 22, 2025Updated 9 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, …☆7,003Updated this week
- An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.☆1,985Aug 9, 2025Updated 9 months ago
- The All-in-one Judge Models introduced by Opencompass☆120Jul 15, 2025Updated 10 months ago
- Code for Findings of ACL 2021 paper "Addressing Inquiries about History: An Efficient and Practical Framework for Evaluating Open-domain …☆19Dec 16, 2022Updated 3 years ago
- Towards Quantifiable Dialogue Coherence Evaluation (ACL 2021)☆58Oct 26, 2021Updated 4 years ago
- PyTorch Sphinx Theme☆13Apr 25, 2023Updated 3 years ago
- RewardBench: the first evaluation tool for reward models.☆715Feb 16, 2026Updated 3 months ago
- Code and Data for EMNLP 2023 Paper "MenatQA: A New Dataset for Testing the Temporal Comprehension and Reasoning Abilities of Large Langu…☆14Apr 7, 2025Updated last year
- ☆15Nov 30, 2020Updated 5 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Code Repository For ACL2021 Paper - DynaEval: Unifying Turn and Dialogue Level Evaluation☆12Sep 2, 2022Updated 3 years ago
- [EMNLP 2024 Findings] ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs☆29May 22, 2025Updated 11 months ago
- Official repository of MMDU dataset☆105Sep 29, 2024Updated last year
- ☆31Jan 16, 2021Updated 5 years ago
- python project template for personal projects! 🙋♀️☆11Nov 28, 2020Updated 5 years ago
- ICLR 2026 - official implementation for "MathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval"☆91Apr 21, 2026Updated 3 weeks ago
- ☆13Mar 1, 2022Updated 4 years ago
- ☆13Sep 20, 2020Updated 5 years ago
- The Math23k dataset for downloading☆21Apr 16, 2022Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- [NeurIPS 2021] "Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models" by Boxin Wang*, Chejian Xu*, Shuoh…☆13Apr 3, 2023Updated 3 years ago
- Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code☆10Aug 29, 2023Updated 2 years ago
- LongBench v2 and LongBench (ACL 25'&24')☆1,169Jan 15, 2025Updated last year
- ☆163Nov 23, 2024Updated last year
- ☆98Dec 5, 2023Updated 2 years ago
- Code for SIGdial 2020 paper: Unsupervised Evaluation of Interactive Dialog with DialoGPT (https://arxiv.org/abs/2006.12719)☆28Jun 8, 2020Updated 5 years ago
- SuperCLUE-Role中文原生角色扮演测评基准☆37Apr 3, 2024Updated 2 years ago