[ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models
☆118Jun 12, 2025Updated last year
Alternatives and similar repositories for FollowBench
Users that are interested in FollowBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR 2025] Bridging and Modeling Correlations in Pairwise Data for Direct Preference Optimization☆12Jan 26, 2025Updated last year
- Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)☆102Feb 20, 2025Updated last year
- This repo contains my reimplementation and improvement of DeepLOB model.☆32Apr 22, 2021Updated 5 years ago
- ☆61Aug 22, 2024Updated last year
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…☆55Jun 24, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [ACL 2024] Learning to Edit: Aligning LLMs with Knowledge Editing☆37Aug 19, 2024Updated last year
- CFBench: A Comprehensive Constraints-Following Benchmark for LLMs☆55Aug 26, 2024Updated last year
- Conifer: Improving Complex Constrained Instruction-Following Ability of Large Language Models☆91Apr 4, 2024Updated 2 years ago
- Code and data for the paper "Can Large Language Models Understand Real-World Complex Instructions?"(AAAI2024)☆51Apr 19, 2024Updated 2 years ago
- ☆335Jul 25, 2024Updated last year
- ☆18Feb 29, 2024Updated 2 years ago
- SysBench: Can Large Language Models Follow System Messages?☆40Sep 4, 2024Updated last year
- [ICLR 2024] COLLIE: Systematic Construction of Constrained Text Generation Tasks☆63Aug 2, 2023Updated 2 years ago
- Code of EMNLP 2025 paper 'UltraIF: Advancing Instruction Following from the Wild'.☆21Apr 3, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning☆287Aug 20, 2023Updated 2 years ago
- [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning☆31Mar 5, 2024Updated 2 years ago
- 使用MovieLens数据集实现了基于Auto Encoder(AE), Variational Auto Encoder(VAE), BERT的深度学习电影推荐系统☆77Dec 18, 2020Updated 5 years ago
- Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]☆599Dec 9, 2024Updated last year
- [EMNLP 2023] Lion: Adversarial Distillation of Proprietary Large Language Models☆210Feb 11, 2024Updated 2 years ago
- Implementations of online merging optimizers proposed by Online Merging Optimizers for Boosting Rewards and Mitigating Tax in Alignment☆82Jun 19, 2024Updated 2 years ago
- [EMNLP 2022] Improved Universal Sentence Embeddings with Prompt-based Contrastive Learning and Energy-based Learning☆136Nov 17, 2023Updated 2 years ago
- 大模型多维度中文对齐评测基准 (ACL 2024)☆430Oct 25, 2025Updated 8 months ago
- [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues☆152Jul 24, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆98Nov 6, 2024Updated last year
- [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following☆138Jul 8, 2024Updated 2 years ago
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆268Sep 12, 2024Updated last year
- [ACL 2024 Findings] The official repo for "ConceptMath: A Bilingual Concept-wise Benchmark for Measuring Mathematical Reasoning of Large …☆26May 29, 2024Updated 2 years ago
- Reformatted Alignment☆111Sep 23, 2024Updated last year
- [ICML 2024] Selecting High-Quality Data for Training Language Models☆204Dec 8, 2025Updated 7 months ago
- ☆30Dec 27, 2024Updated last year
- Use BiLSTM_attention, BERT, ALBERT, RoBERTa, XLNet model to classify the SST-2 data set based on pytorch☆111Dec 9, 2020Updated 5 years ago
- The code and data for the paper JiuZhang3.0☆49May 26, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Recipe for Building LLM Reasoners to Solve Complex Instructions☆32Oct 9, 2025Updated 9 months ago
- The official repository of the Omni-MATH benchmark.☆94Dec 22, 2024Updated last year
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆146Oct 27, 2024Updated last year
- ☆98Mar 20, 2024Updated 2 years ago
- Code and Data for EMNLP 2023 Paper "MenatQA: A New Dataset for Testing the Temporal Comprehension and Reasoning Abilities of Large Langu…☆14Apr 7, 2025Updated last year
- The evaluation code for MultiIF multi-turn and multi-lingual instruction following☆63Oct 29, 2024Updated last year
- Arena-Hard-Auto: An automatic LLM benchmark.☆1,050Jun 21, 2025Updated last year