Alternatives and similar repositories for SysBench

Users that are interested in SysBench are comparing it to the libraries listed below

• qinyiwei / InfoBench
  ☆57Updated last year
• Abbey4799 / CELLO
  Code and data for the paper "Can Large Language Models Understand Real-World Complex Instructions?"(AAAI2024)
  ☆50Updated last year
• thu-coai / ComplexBench
  Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)
  ☆96Updated 8 months ago
• meowpass / FollowComplexInstruction
  Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…
  ☆51Updated last year
• ChiyuSONG / dynamics-of-instruction-tuning
  ☆17Updated 8 months ago
• YJiangcm / FollowBench
  [ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models
  ☆117Updated 4 months ago
• PlusLabNLP / Active-IT
  Code for our EMNLP-2023 paper: "Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks"
  ☆25Updated last year
• icip-cas / awesome-auto-alignment
  Collection of papers for scalable automated alignment.
  ☆94Updated last year
• siyuyuan / coscript
  Resources for our ACL 2023 paper: Distilling Script Knowledge from Large Language Models for Constrained Language Planning
  ☆36Updated 2 years ago
• OpenLMLab / LongWanjuan
  Towards Systematic Measurement for Long Text Quality
  ☆37Updated last year
• Zce1112zslx / IKE
  ☆40Updated last year
• DAMO-NLP-SG / TempReason
  ☆33Updated last year
• FranxYao / FlanT5-CoT-Specialization
  Implementation of ICML 23 Paper: Specializing Smaller Language Models towards Multi-Step Reasoning.
  ☆131Updated 2 years ago
• Shark-NLP / self-adaptive-ICL
  self-adaptive in-context learning
  ☆45Updated 2 years ago
• qiancheng0 / CREATOR
  This is the repository for paper "CREATOR: Tool Creation for Disentangling Abstract and Concrete Reasoning of Large Language Models"
  ☆28Updated 2 years ago
• FreedomIntelligence / OVM
  ☆69Updated last year
• csitfun / LogiQA2.0
  Logiqa2.0 dataset - logical reasoning in MRC and NLI tasks
  ☆99Updated 2 years ago
• PKU-Baichuan-MLSystemLab / CFBench
  CFBench: A Comprehensive Constraints-Following Benchmark for LLMs
  ☆43Updated last year
• RUCAIBox / LLM-Knowledge-Boundary
  Implementation of "Investigating the Factual Knowledge Boundary of Large Language Models with Retrieval Augmentation"
  ☆82Updated 2 years ago
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆83Updated last year
• yinzhangyue / SelfAware
  Do Large Language Models Know What They Don’t Know?
  ☆101Updated last year
• ChengpengLi1003 / DotaMath
  ☆30Updated 10 months ago
• Spico197 / MoE-SFT
  🍼 Official implementation of Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts
  ☆41Updated last year
• Junjie-Ye / ToolEyes
  [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios
  ☆70Updated 5 months ago
• Spico197 / awesome-lm-evaluation
  🩺 A collection of ChatGPT evaluation reports on various bechmarks.
  ☆50Updated 2 years ago
• THU-KEG / VerIF
  [EMNLP 2025] Verification Engineering for RL in Instruction Following
  ☆40Updated last month
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆63Updated last year
• ZitongYang / Synthetic_Continued_Pretraining
  Code implementation of synthetic continued pretraining
  ☆137Updated 10 months ago
• pldlgb / nuggets
  ☆85Updated last year
• princeton-nlp / LLMBar
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆132Updated last year