[NIPS 2025 DB Spotlight] AGENTIF: Benchmarking Instruction Following of Large Language Models in Agentic Scenarios
☆29Dec 1, 2025Updated 3 months ago
Alternatives and similar repositories for AgentIF
Users that are interested in AgentIF are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [CIKM 2025] Constraint Back-translation Improves Complex Instruction Following of Large Language Models☆17May 23, 2025Updated 10 months ago
- [KDD 2025] AtomR: Atomic Operator-Empowered Large Language Models for Heterogeneous Knowledge Reasoning☆15May 27, 2025Updated 9 months ago
- [EMNLP 2025] Verification Engineering for RL in Instruction Following☆53Jan 5, 2026Updated 2 months ago
- The official code and dataset for EMNLP 2022 paper "COPEN: Probing Conceptual Knowledge in Pre-trained Language Models".☆21Mar 9, 2023Updated 3 years ago
- Codes for paper SoAy: A Service-oriented APIs Applying Framework of Large Language Models☆27Jul 14, 2025Updated 8 months ago
- [KDD24-ADS] R-Eval: A Unified Toolkit for Evaluating Domain Knowledge of Retrieval Augmented Large Language Models☆11Apr 9, 2024Updated last year
- [COLING 2025] NesTools: A Dataset for Evaluating Nested Tool Learning Abilities of Large Language Models☆18Jan 18, 2025Updated last year
- Based on EEG signal, the differential entropy feature is extracted, and the convolution neural network based on time domain network and a…☆13Sep 21, 2022Updated 3 years ago
- Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructions☆48Sep 13, 2025Updated 6 months ago
- [CIKM 2025] LLMAEL: Large Language Models are Good Context Augmenters for Entity Linking☆17Sep 6, 2025Updated 6 months ago
- ☆43Jun 26, 2024Updated last year
- ☆62Oct 29, 2024Updated last year
- Berkeley Function Calling Leaderboard (BFCL) with Chinese-Language Evaluation☆23Apr 6, 2025Updated 11 months ago
- Code and data for NAACL 2025 paper "IHEval: Evaluating Language Models on Following the Instruction Hierarchy"☆16Feb 25, 2025Updated last year
- ☆14Aug 15, 2024Updated last year
- [ICLR 25 Oral] RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style☆78Jul 18, 2025Updated 8 months ago
- ☆60Dec 9, 2022Updated 3 years ago
- [ACL 2025] The official repository for "HyKGE: A Hypothesis Knowledge Graph Enhanced Framework for Accurate and Reliable Medical LLMs Res…☆21Feb 27, 2025Updated last year
- [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems☆125Jun 11, 2025Updated 9 months ago
- Knowledge Oriented Programming Language☆85Aug 12, 2022Updated 3 years ago
- Code for ACL 2022 paper "HIBRIDS: Attention with Hierarchical Biases for Structure-aware Long Document Summarization".☆13May 24, 2022Updated 3 years ago
- Repository of paper "Establishing Trustworthy LLM Evaluation via Shortcut Neuron Analysis" (ACL 2025 Main)☆19Jul 19, 2025Updated 8 months ago
- Official Implementation of "Probing Language Models for Pre-training Data Detection"☆20Dec 4, 2024Updated last year
- ☆27Jun 18, 2025Updated 9 months ago
- Repositório para materiais e documentos relevantes usados na XI EMMSB.☆14Sep 3, 2024Updated last year
- DICE: Detecting In-distribution Data Contamination with LLM's Internal State☆11Sep 21, 2024Updated last year
- ☆59Aug 1, 2023Updated 2 years ago
- Data and code for the paper: Finding Safety Neurons in Large Language Models☆23Jan 29, 2026Updated last month
- Source code for EMNLP 2023 paper "Probabilistic Tree-of-thought Reasoning for Answering Knowledge-intensive Complex Questions".☆23Mar 21, 2024Updated 2 years ago
- ☆13Nov 7, 2023Updated 2 years ago
- Completing the Puzzle of All-in-One Event Understanding Benchmark with Event Arguments☆14Mar 12, 2024Updated 2 years ago
- [ICLR 2025] Permute-and-Flip: An optimally robust and watermarkable decoder for LLMs☆19Mar 20, 2025Updated last year
- [ACM MM25] LongWriter-V: Enabling Ultra-Long and High-Fidelity Generation in Vision-Language Models☆23Mar 29, 2025Updated 11 months ago
- [EMNLP 2024] RoTBench: A Multi-Level Benchmark for Evaluating the Robustness of Large Language Models in Tool Learning☆15May 13, 2025Updated 10 months ago
- ☆32Apr 14, 2022Updated 3 years ago
- ☆28Apr 17, 2025Updated 11 months ago
- The document for pdfdeal☆29Feb 20, 2025Updated last year
- This is a repo listing some must-read papers on *AI-driven MOOCs* or *Intelligent Education* published in recent years, mainly contribute…☆16Jun 8, 2022Updated 3 years ago
- The official repo for the code and data of paper SMART☆40Feb 20, 2025Updated last year