Alternatives and similar repositories for SysBench:

Users that are interested in SysBench are comparing it to the libraries listed below

• Abbey4799 / CELLO
  Code and data for the paper "Can Large Language Models Understand Real-World Complex Instructions?"(AAAI2024)
  ☆48Updated 11 months ago
• meowpass / FollowComplexInstruction
  Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…
  ☆46Updated 9 months ago
• qinyiwei / InfoBench
  ☆53Updated 7 months ago
• OpenLMLab / LongWanjuan
  Towards Systematic Measurement for Long Text Quality
  ☆34Updated 6 months ago
• PKU-Baichuan-MLSystemLab / CFBench
  CFBench: A Comprehensive Constraints-Following Benchmark for LLMs
  ☆30Updated 7 months ago
• thu-coai / ComplexBench
  Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)
  ☆76Updated last month
• siyuyuan / coscript
  Resources for our ACL 2023 paper: Distilling Script Knowledge from Large Language Models for Constrained Language Planning
  ☆36Updated last year
• DAMO-NLP-SG / TempReason
  ☆31Updated last year
• PlusLabNLP / Active-IT
  Code for our EMNLP-2023 paper: "Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks"
  ☆24Updated last year
• October2001 / ProLong
  [ACL 2024 (Oral)] A Prospector of Long-Dependency Data for Large Language Models
  ☆54Updated 8 months ago
• YJiangcm / FollowBench
  [ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models
  ☆97Updated 3 months ago
• yizhilll / CIF-Bench
  ☆15Updated last year
• icip-cas / awesome-auto-alignment
  Collection of papers for scalable automated alignment.
  ☆87Updated 5 months ago
• Junjie-Ye / ToolEyes
  [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios
  ☆65Updated 4 months ago
• fanqiwan / KCA
  EMNLP'2024: Knowledge Verification to Nip Hallucination in the Bud
  ☆22Updated last year
• ChiyuSONG / dynamics-of-instruction-tuning
  ☆16Updated last month
• zhaochen0110 / conflictbank
  Code and data for "ConflictBank: A Benchmark for Evaluating the Influence of Knowledge Conflicts in LLM" (NeurIPS 2024 Track Datasets and…
  ☆38Updated 5 months ago
• RUCAIBox / LLM-Knowledge-Boundary
  Implementation of "Investigating the Factual Knowledge Boundary of Large Language Models with Retrieval Augmentation"
  ☆79Updated last year
• SparkJiao / dpo-trajectory-reasoning
  [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".
  ☆74Updated 2 months ago
• LuckyyySTA / Fine-grained-Attribution
  [ACL 2024 Findings] Learning Fine-Grained Grounded Citations for Attributed Large Language Models
  ☆17Updated 5 months ago
• THU-KEG / KoLA
  [ICLR24] The open-source repo of THU-KEG's KoLA benchmark.
  ☆50Updated last year
• KbsdJames / MATH-Minos
  The implementation of paper "LLM Critics Help Catch Bugs in Mathematics: Towards a Better Mathematical Verifier with Natural Language Fee…
  ☆38Updated 8 months ago
• ChengpengLi1003 / DotaMath
  ☆29Updated 3 months ago
• GAIR-NLP / OPO
  ☆49Updated last year
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆46Updated 3 months ago
• xlang-ai / BRIGHT
  BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
  ☆94Updated last month
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆56Updated 8 months ago
• pillowsofwind / Knowledge-Conflicts-Survey
  [EMNLP 2024] The official GitHub repo for the survey paper "Knowledge Conflicts for LLMs: A Survey"
  ☆111Updated 6 months ago
• RUCAIBox / HaluEval-2.0
  ☆41Updated last year
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆79Updated last year