Evaluating LLMs' multi-round chatting capability via assessing conversations generated by two LLM instances.
☆163May 22, 2025Updated last year
Alternatives and similar repositories for BotChat
Users that are interested in BotChat are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆11Nov 5, 2024Updated last year
- [ACL 2024 Findings] MathBench: A Comprehensive Multi-Level Difficulty Mathematics Evaluation Dataset☆118May 22, 2025Updated last year
- Code and data for "MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models"☆57Nov 18, 2025Updated 10 months ago
- The official implementation of "Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks"☆56May 22, 2025Updated last year
- [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues☆153Jul 24, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…☆144Jun 4, 2024Updated 2 years ago
- A Dataset for Multi-Turn Dialogue Reasoning☆334Oct 7, 2020Updated 6 years ago
- ☆17Oct 21, 2024Updated last year
- This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"☆17Feb 22, 2024Updated 2 years ago
- ☆58Nov 1, 2021Updated 4 years ago
- Generative Judge for Evaluating Alignment☆253Jan 18, 2024Updated 2 years ago
- Code for ACL 2021 paper "Unsupervised Out-of-Domain Detection via Pre-trained Transformers"☆30Aug 20, 2021Updated 5 years ago
- [NeurIPS 2024] A comprehensive benchmark for evaluating critique ability of LLMs☆51Nov 29, 2024Updated last year
- Code and Data for EMNLP 2023 Paper "MenatQA: A New Dataset for Testing the Temporal Comprehension and Reasoning Abilities of Large Langu…☆14Apr 7, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, ac…☆7,505Updated this week
- A multi-language code evaluation tool.☆28Jan 26, 2024Updated 2 years ago
- An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.☆2,019Aug 9, 2025Updated last year
- Group R-CNN for Point-based Weakly Semi-supervised Object Detection (CVPR2022)☆136May 24, 2023Updated 3 years ago
- Towards Quantifiable Dialogue Coherence Evaluation (ACL 2021)☆58Oct 26, 2021Updated 4 years ago
- PyTorch Sphinx Theme☆13Apr 25, 2023Updated 3 years ago
- ☆31Jan 16, 2021Updated 5 years ago
- Code Repository For ACL2021 Paper - DynaEval: Unifying Turn and Dialogue Level Evaluation☆12Sep 2, 2022Updated 4 years ago
- A Python tool for automatic constructing and downloading paper list☆16Oct 16, 2019Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- RewardBench: the first evaluation tool for reward models.☆740Sep 30, 2026Updated last week
- Official repository for "DEnsity: Open-domain Dialogue Evaluation Metric using Density Estimation (ACL2023 Findings)"☆11May 23, 2023Updated 3 years ago
- ☆15Nov 30, 2020Updated 5 years ago
- The Math23k dataset for downloading☆22Apr 16, 2022Updated 4 years ago
- [EMNLP 2024 Findings] ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs☆30May 22, 2025Updated last year
- python project template for personal projects! 🙋♀️☆11Nov 28, 2020Updated 5 years ago
- Official repository of MMDU dataset☆110Sep 29, 2024Updated 2 years ago
- Code for InfoDeepSeek: Benchmarking Agentic Information Seeking for Retrieval-Augmented Generation☆20May 29, 2025Updated last year
- Assessing Context-Aware Creative Intelligence in MLLMs☆23Jul 22, 2025Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- [EMNLP 2025] CompassVerifier: A Unified and Robust Verifier for LLMs Evaluation and Outcome Reward☆71Aug 10, 2025Updated last year
- ☆13Sep 20, 2020Updated 6 years ago
- [NeurIPS 2021] "Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models" by Boxin Wang*, Chejian Xu*, Shuoh…☆13Apr 3, 2023Updated 3 years ago
- The repo of ASGMVLP☆19Jan 16, 2026Updated 8 months ago
- LongBench v2 and LongBench (ACL 25'&24')☆1,245Jan 15, 2025Updated last year
- Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code☆11Aug 29, 2023Updated 3 years ago
- Code for SIGdial 2020 paper: Unsupervised Evaluation of Interactive Dialog with DialoGPT (https://arxiv.org/abs/2006.12719)☆28Jun 8, 2020Updated 6 years ago