Alternatives and similar repositories for SysBench:

Users that are interested in SysBench are comparing it to the libraries listed below

• Abbey4799 / CELLO
  Code and data for the paper "Can Large Language Models Understand Real-World Complex Instructions?"(AAAI2024)
  ☆47Updated 10 months ago
• meowpass / FollowComplexInstruction
  Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…
  ☆46Updated 8 months ago
• PKU-Baichuan-MLSystemLab / CFBench
  CFBench: A Comprehensive Constraints-Following Benchmark for LLMs
  ☆29Updated 6 months ago
• fanqiwan / KCA
  EMNLP'2024: Knowledge Verification to Nip Hallucination in the Bud
  ☆22Updated 11 months ago
• thu-coai / CharacterBench
  [AAAI'25] CharacterBench: Benchmarking Character Customization of Large Language Models
  ☆13Updated 2 months ago
• PlusLabNLP / Active-IT
  Code for our EMNLP-2023 paper: "Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks"
  ☆24Updated last year
• thu-coai / ComplexBench
  Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)
  ☆68Updated last week
• qinyiwei / InfoBench
  ☆52Updated 6 months ago
• OpenLMLab / LongWanjuan
  Towards Systematic Measurement for Long Text Quality
  ☆32Updated 5 months ago
• siyuyuan / coscript
  Resources for our ACL 2023 paper: Distilling Script Knowledge from Large Language Models for Constrained Language Planning
  ☆36Updated last year
• ChiyuSONG / dynamics-of-instruction-tuning
  ☆16Updated last year
• RUCAIBox / LLM-Knowledge-Boundary
  Implementation of "Investigating the Factual Knowledge Boundary of Large Language Models with Retrieval Augmentation"
  ☆79Updated last year
• yizhilll / CIF-Bench
  ☆15Updated last year
• RuochenZhao / Verify-and-Edit
  A framework for editing the CoTs for better factuality
  ☆48Updated last year
• DAMO-NLP-SG / TempReason
  ☆31Updated last year
• RUCAIBox / HaluEval-2.0
  ☆38Updated last year
• ChengpengLi1003 / DotaMath
  ☆29Updated 2 months ago
• icip-cas / awesome-auto-alignment
  Collection of papers for scalable automated alignment.
  ☆84Updated 4 months ago
• YJiangcm / FollowBench
  [ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models
  ☆96Updated 2 months ago
• Alsace08 / SumCoT
  Code and Data Repo for [ACL 2023] Paper "Element-aware Summary and Summary Chain-of-Thought (SumCoT)"
  ☆53Updated last year
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆79Updated last year
• pldlgb / nuggets
  ☆80Updated last year
• Junjie-Ye / ToolEyes
  [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios
  ☆65Updated 3 months ago
• KwanWaiChung / MT-Eval
  Code and data for "MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models"
  ☆35Updated 4 months ago
• oriyor / ret-robust
  Implementation of the paper: "Making Retrieval-Augmented Language Models Robust to Irrelevant Context"
  ☆66Updated 6 months ago
• tianyi-lab / Superfiltering
  [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning
  ☆143Updated 5 months ago
• yunx-z / COMBO
  Merging Generated and Retrieved Knowledge for Open-Domain QA (EMNLP 2023)
  ☆22Updated last year
• Spico197 / MoE-SFT
  🍼 Official implementation of Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts
  ☆38Updated 5 months ago
• THU-KEG / KoLA
  [ICLR24] The open-source repo of THU-KEG's KoLA benchmark.
  ☆50Updated last year
• wwxu21 / CUT
  Source code of "Reasons to Reject? Aligning Language Models with Judgments"
  ☆58Updated last year