CFBench: A Comprehensive Constraints-Following Benchmark for LLMs
☆47Aug 26, 2024Updated last year
Alternatives and similar repositories for CFBench
Users that are interested in CFBench are comparing it to the libraries listed below
Sorting:
- SysBench: Can Large Language Models Follow System Messages?☆39Sep 4, 2024Updated last year
- Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)☆102Feb 20, 2025Updated last year
- [ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models☆119Jun 12, 2025Updated 8 months ago
- ☆59Aug 22, 2024Updated last year
- ☆13Aug 11, 2024Updated last year
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…☆53Jun 24, 2024Updated last year
- Code and data for the paper "Can Large Language Models Understand Real-World Complex Instructions?"(AAAI2024)☆50Apr 19, 2024Updated last year
- [ACL25] FEA-Bench: A Benchmark for Evaluating Repository-Level Code Generation for Feature Implementation☆44Jan 28, 2026Updated last month
- Reproducing R1 for Code with Reliable Rewards☆12Apr 9, 2025Updated 10 months ago
- 数据合成工具，简单高效的合成不同业务场景的大模型训练数据☆40Jan 2, 2025Updated last year
- Berkeley Function Calling Leaderboard (BFCL) with Chinese-Language Evaluation☆23Apr 6, 2025Updated 10 months ago
- Code of EMNLP 2025 paper 'UltraIF: Advancing Instruction Following from the Wild'.☆21Apr 3, 2025Updated 10 months ago
- ☆18Feb 29, 2024Updated 2 years ago
- Code and models for EMNLP 2024 paper "WPO: Enhancing RLHF with Weighted Preference Optimization"☆41Sep 24, 2024Updated last year
- [ACL25' Findings] SWE-Dev is an SWE agent with a scalable test case construction pipeline.☆59Jul 21, 2025Updated 7 months ago
- ☆87Dec 29, 2023Updated 2 years ago
- ☆54Sep 11, 2024Updated last year
- [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning☆30Mar 5, 2024Updated last year
- ☆324Jul 25, 2024Updated last year
- This repository contains the data and code for the paper "Diverse Text Generation via Variational Encoder-Decoder Models with Gaussian Pr…☆26Jun 27, 2022Updated 3 years ago
- ☆28Nov 10, 2025Updated 3 months ago
- ☆30Dec 27, 2024Updated last year
- Collection of scripts to pretrain T5 in unsupervised text, using PyTorch Lightning. CORD-19 pretraining provided as example.☆32Apr 26, 2021Updated 4 years ago
- The official repository of the Omni-MATH benchmark.☆93Dec 22, 2024Updated last year
- Information-oriented Metric (IOM)☆11Sep 2, 2020Updated 5 years ago
- Entropy-Driven GRPO with Guided Error Correction for Advantage Diversity☆22Aug 28, 2025Updated 6 months ago
- [ICLR 2024] This is the official implementation for the paper: "Beyond imitation: Leveraging fine-grained quality signals for alignment"☆10May 5, 2024Updated last year
- Conifer: Improving Complex Constrained Instruction-Following Ability of Large Language Models☆89Apr 4, 2024Updated last year
- A python implementation of PROCLUS: PROjected CLUStering algorithm.☆10Jan 12, 2015Updated 11 years ago
- Implementation for the paper "Unified Multimodal Model with Unlikelihood Training for Visual Dialog"☆13May 12, 2023Updated 2 years ago
- ☆43Mar 14, 2025Updated 11 months ago
- Nr. 1 ranked "Pitch Detector" on the web. Implemented with WebAssembly.☆11Mar 24, 2021Updated 4 years ago
- Real-time multi-language unit test generation tool via LSP☆31Updated this week
- ☆16Jun 25, 2025Updated 8 months ago
- Flexible, extensible and scalable web-based speech annotation tool☆14Apr 4, 2025Updated 10 months ago
- SuperCLUE-Agent: 基于中文原生任务的Agent智能体核心能力测评基准☆94Nov 9, 2023Updated 2 years ago
- A logging-friendly stopwatch and profiling tool for Python.☆11Mar 6, 2025Updated 11 months ago
- ☆14Jul 19, 2024Updated last year
- ☆15Updated this week