Alternatives and similar repositories for SysBench

Users that are interested in SysBench are comparing it to the libraries listed below

• qinyiwei / InfoBench
  ☆58Updated last year
• Abbey4799 / CELLO
  Code and data for the paper "Can Large Language Models Understand Real-World Complex Instructions?"(AAAI2024)
  ☆50Updated last year
• ChiyuSONG / dynamics-of-instruction-tuning
  ☆17Updated 11 months ago
• DAMO-NLP-SG / TempReason
  ☆32Updated 2 years ago
• thu-coai / ComplexBench
  Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)
  ☆101Updated 11 months ago
• yale-nlp / QTSumm
  Data and Code for EMNLP 2023 paper "QTSumm: Query-Focused Summarization over Tabular Data"
  ☆22Updated last year
• YJiangcm / FollowBench
  [ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models
  ☆119Updated 7 months ago
• OpenLMLab / LongWanjuan
  Towards Systematic Measurement for Long Text Quality
  ☆37Updated last year
• meowpass / FollowComplexInstruction
  Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…
  ☆53Updated last year
• PlusLabNLP / Active-IT
  Code for our EMNLP-2023 paper: "Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks"
  ☆25Updated 2 years ago
• FreedomIntelligence / OVM
  ☆72Updated last year
• Alsace08 / SumCoT
  [ACL 2023] Code and Data Repo for Paper "Element-aware Summary and Summary Chain-of-Thought (SumCoT)"
  ☆53Updated 2 years ago
• shizhediao / R-Tuning
  [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…
  ☆129Updated last year
• SparkJiao / dpo-trajectory-reasoning
  [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".
  ☆83Updated last year
• OSU-NLP-Group / LLM-Knowledge-Conflict
  [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"
  ☆81Updated last year
• icip-cas / awesome-auto-alignment
  Collection of papers for scalable automated alignment.
  ☆93Updated last year
• yinzhangyue / SelfAware
  Do Large Language Models Know What They Don’t Know?
  ☆102Updated last year
• FranxYao / FlanT5-CoT-Specialization
  Implementation of ICML 23 Paper: Specializing Smaller Language Models towards Multi-Step Reasoning.
  ☆132Updated 2 years ago
• siyuyuan / coscript
  Resources for our ACL 2023 paper: Distilling Script Knowledge from Large Language Models for Constrained Language Planning
  ☆36Updated 2 years ago
• RUCAIBox / LLM-Knowledge-Boundary
  Implementation of "Investigating the Factual Knowledge Boundary of Large Language Models with Retrieval Augmentation"
  ☆82Updated 2 years ago
• qiancheng0 / CREATOR
  This is the repository for paper "CREATOR: Tool Creation for Disentangling Abstract and Concrete Reasoning of Large Language Models"
  ☆29Updated 2 years ago
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆64Updated last year
• princeton-nlp / LLMBar
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆136Updated last year
• DAMO-NLP-SG / contrastive-cot
  Contrastive Chain-of-Thought Prompting
  ☆68Updated 2 years ago
• October2001 / ProLong
  [ACL 2024 (Oral)] A Prospector of Long-Dependency Data for Large Language Models
  ☆59Updated last year
• Alab-NII / 2wikimultihop
  ☆138Updated 2 years ago
• zhaochen0110 / conflictbank
  Code and data for "ConflictBank: A Benchmark for Evaluating the Influence of Knowledge Conflicts in LLM" (NeurIPS 2024 Track Datasets and…
  ☆64Updated 8 months ago
• ChengpengLi1003 / DotaMath
  ☆30Updated last year
• wzhouad / context-faithful-llm
  Code and data for paper "Context-faithful Prompting for Large Language Models".
  ☆42Updated 2 years ago
• Di-viner / LLM-Robustness-to-Irrelevant-Information
  [COLM'24] "How Easily do Irrelevant Inputs Skew the Responses of Large Language Models?"
  ☆22Updated last year