Alternatives and similar repositories for SysBench

Users that are interested in SysBench are comparing it to the libraries listed below

• qinyiwei / InfoBench
  ☆58Updated last year
• thu-coai / ComplexBench
  Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)
  ☆99Updated 10 months ago
• DAMO-NLP-SG / TempReason
  ☆32Updated 2 years ago
• Di-viner / LLM-Robustness-to-Irrelevant-Information
  [COLM'24] "How Easily do Irrelevant Inputs Skew the Responses of Large Language Models?"
  ☆22Updated last year
• siyuyuan / coscript
  Resources for our ACL 2023 paper: Distilling Script Knowledge from Large Language Models for Constrained Language Planning
  ☆36Updated 2 years ago
• Abbey4799 / CELLO
  Code and data for the paper "Can Large Language Models Understand Real-World Complex Instructions?"(AAAI2024)
  ☆50Updated last year
• RUCAIBox / LLM-Knowledge-Boundary
  Implementation of "Investigating the Factual Knowledge Boundary of Large Language Models with Retrieval Augmentation"
  ☆82Updated 2 years ago
• yinzhangyue / SelfAware
  Do Large Language Models Know What They Don’t Know?
  ☆102Updated last year
• ChiyuSONG / dynamics-of-instruction-tuning
  ☆17Updated 10 months ago
• c-box / KnowledgeLifecycle
  Paper list of "The Life Cycle of Knowledge in Big Language Models: A Survey"
  ☆59Updated 2 years ago
• oriyor / ret-robust
  Implementation of the paper: "Making Retrieval-Augmented Language Models Robust to Irrelevant Context"
  ☆76Updated last year
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆64Updated last year
• PlusLabNLP / Active-IT
  Code for our EMNLP-2023 paper: "Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks"
  ☆25Updated 2 years ago
• OpenLMLab / LongWanjuan
  Towards Systematic Measurement for Long Text Quality
  ☆37Updated last year
• YJiangcm / FollowBench
  [ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models
  ☆118Updated 7 months ago
• OSU-NLP-Group / LLM-Knowledge-Conflict
  [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"
  ☆82Updated last year
• feyzaakyurek / dune
  Dataset for Unified Editing, EMNLP 2023. This is a model editing dataset where edits are natural language phrases.
  ☆22Updated last year
• meowpass / FollowComplexInstruction
  Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…
  ☆53Updated last year
• Alsace08 / SumCoT
  [ACL 2023] Code and Data Repo for Paper "Element-aware Summary and Summary Chain-of-Thought (SumCoT)"
  ☆53Updated last year
• princeton-nlp / MQuAKE
  [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions
  ☆118Updated last year
• hrwise-nlp / ToolsMeetLLMs
  ☆31Updated 8 months ago
• icip-cas / awesome-auto-alignment
  Collection of papers for scalable automated alignment.
  ☆93Updated last year
• HillZhang1999 / ICD
  Code & Data for our Paper "Alleviating Hallucinations of Large Language Models through Induced Hallucinations"
  ☆69Updated last year
• THU-KEG / VerIF
  [EMNLP 2025] Verification Engineering for RL in Instruction Following
  ☆46Updated this week
• Junjie-Ye / ToolEyes
  [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios
  ☆73Updated 7 months ago
• shizhediao / R-Tuning
  [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…
  ☆126Updated last year
• THU-KEG / KoLA
  [ICLR24] The open-source repo of THU-KEG's KoLA benchmark.
  ☆52Updated 2 years ago
• Shark-NLP / self-adaptive-ICL
  self-adaptive in-context learning
  ☆45Updated 2 years ago
• OhadRubin / EPR
  ☆64Updated 3 years ago
• iwangjian / TopDial
  Target-oriented Proactive Dialogue Systems with Personalization: Problem Formulation and Dataset Curation (EMNLP 2023)
  ☆31Updated 2 months ago