Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)
☆105Feb 20, 2025Updated last year
Alternatives and similar repositories for ComplexBench
Users that are interested in ComplexBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models☆121Jun 12, 2025Updated last year
- Code and data for the paper "Can Large Language Models Understand Real-World Complex Instructions?"(AAAI2024)☆51Apr 19, 2024Updated 2 years ago
- A Recipe for Building LLM Reasoners to Solve Complex Instructions☆32Oct 9, 2025Updated last year
- ☆62Aug 22, 2024Updated 2 years ago
- CFBench: A Comprehensive Constraints-Following Benchmark for LLMs☆57Aug 26, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…☆55Jun 24, 2024Updated 2 years ago
- Code of EMNLP 2025 paper 'UltraIF: Advancing Instruction Following from the Wild'.☆21Apr 3, 2025Updated last year
- ☆338Jul 25, 2024Updated 2 years ago
- Conifer: Improving Complex Constrained Instruction-Following Ability of Large Language Models☆91Apr 4, 2024Updated 2 years ago
- ☆18Feb 29, 2024Updated 2 years ago
- SysBench: Can Large Language Models Follow System Messages?☆42Sep 4, 2024Updated 2 years ago
- Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging. Arxiv, 2024.☆16Oct 28, 2024Updated 2 years ago
- InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning☆291Aug 20, 2023Updated 3 years ago
- Official Implementation of "Learning to Refuse: Towards Mitigating Privacy Risks in LLMs"☆10Dec 13, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Unofficial implementation of Chain of Hindsight (https://arxiv.org/abs/2302.02676) using pytorch and huggingface Trainers.☆11Apr 5, 2023Updated 3 years ago
- [EMNLP 2025] Verification Engineering for RL in Instruction Following☆61Mar 30, 2026Updated 7 months ago
- [ACL 2026] A Multi-Dimensional Constraint Framework for Evaluating and Improving Instruction Following in Large Language Models☆23Jul 10, 2026Updated 3 months ago
- [ACL 2024 Findings] The official repo for "ConceptMath: A Bilingual Concept-wise Benchmark for Measuring Mathematical Reasoning of Large …☆26May 29, 2024Updated 2 years ago
- ☆180Sep 9, 2026Updated last month
- [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following☆143Jul 8, 2024Updated 2 years ago
- Official Repo of "CIBench: Evaluation of LLMs as Code Interpreter "☆15Jul 19, 2024Updated 2 years ago
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆146Oct 27, 2024Updated 2 years ago
- Implementations of online merging optimizers proposed by Online Merging Optimizers for Boosting Rewards and Mitigating Tax in Alignment☆82Jun 19, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- 大模型多维度中文对齐评测基准 (ACL 2024)☆432Oct 25, 2025Updated last year
- The code and data for the paper JiuZhang3.0☆49May 26, 2024Updated 2 years ago
- Butler 是一个用于自动化服务管理和任务调度的工具项目。☆18Oct 17, 2026Updated last week
- ☆20Jun 21, 2025Updated last year
- [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning☆32Mar 5, 2024Updated 2 years ago
- [NeurIPS 2024 D&B] Evaluating Copyright Takedown Methods for Language Models☆17Jul 17, 2024Updated 2 years ago
- Code and data for the FACTOR paper☆54Nov 15, 2023Updated 2 years ago
- ☆28Jun 2, 2026Updated 4 months ago
- Official repo for NeurIPS'24 paper "WAGLE: Strategic Weight Attribution for Effective and Modular Unlearning in Large Language Models"☆19Dec 16, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- instruction-following benchmark for large reasoning models☆50Apr 19, 2026Updated 6 months ago
- ☆30Dec 27, 2024Updated last year
- Sensitive-rs is a Rust library for finding, validating, filtering, and replacing sensitive words. It provides efficient algorithms to han…☆27Updated this week
- Collection of papers for scalable automated alignment.☆90Oct 22, 2024Updated 2 years ago
- General Reasoner: Advancing LLM Reasoning Across All Domains [NeurIPS25]☆233Nov 27, 2025Updated 11 months ago
- 🌏 UI component library for the future, based on WebComponent.☆23Nov 12, 2024Updated last year
- The official implemention of "Depth-Breadth Synergy in RLVR: Unlocking LLM Reasoning Gains with Adaptive Exploration" (ICML 2026)☆27Feb 4, 2026Updated 8 months ago