Alternatives and similar repositories for SysBench

Users that are interested in SysBench are comparing it to the libraries listed below

• DAMO-NLP-SG / TempReason
  ☆33Updated last year
• qinyiwei / InfoBench
  ☆56Updated last year
• Abbey4799 / CELLO
  Code and data for the paper "Can Large Language Models Understand Real-World Complex Instructions?"(AAAI2024)
  ☆49Updated last year
• ChiyuSONG / dynamics-of-instruction-tuning
  ☆17Updated 6 months ago
• siyuyuan / coscript
  Resources for our ACL 2023 paper: Distilling Script Knowledge from Large Language Models for Constrained Language Planning
  ☆36Updated 2 years ago
• thu-coai / ComplexBench
  Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)
  ☆93Updated 7 months ago
• meowpass / FollowComplexInstruction
  Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…
  ☆51Updated last year
• OpenLMLab / LongWanjuan
  Towards Systematic Measurement for Long Text Quality
  ☆37Updated last year
• YJiangcm / FollowBench
  [ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models
  ☆113Updated 3 months ago
• RUCAIBox / LLM-Knowledge-Boundary
  Implementation of "Investigating the Factual Knowledge Boundary of Large Language Models with Retrieval Augmentation"
  ☆82Updated 2 years ago
• PKU-Baichuan-MLSystemLab / CFBench
  CFBench: A Comprehensive Constraints-Following Benchmark for LLMs
  ☆42Updated last year
• PlusLabNLP / Active-IT
  Code for our EMNLP-2023 paper: "Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks"
  ☆24Updated last year
• shizhediao / R-Tuning
  [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…
  ☆120Updated last year
• yale-nlp / QTSumm
  Data and Code for EMNLP 2023 paper "QTSumm: Query-Focused Summarization over Tabular Data"
  ☆21Updated last year
• Di-viner / LLM-Robustness-to-Irrelevant-Information
  [COLM'24] "How Easily do Irrelevant Inputs Skew the Responses of Large Language Models?"
  ☆22Updated 11 months ago
• zhaochen0110 / conflictbank
  Code and data for "ConflictBank: A Benchmark for Evaluating the Influence of Knowledge Conflicts in LLM" (NeurIPS 2024 Track Datasets and…
  ☆50Updated 4 months ago
• sunlab-osu / Understanding-CoT
  ☆88Updated 2 years ago
• qiancheng0 / CREATOR
  This is the repository for paper "CREATOR: Tool Creation for Disentangling Abstract and Concrete Reasoning of Large Language Models"
  ☆25Updated last year
• yinzhangyue / SelfAware
  Do Large Language Models Know What They Don’t Know?
  ☆99Updated 10 months ago
• ZitongYang / Synthetic_Continued_Pretraining
  Code implementation of synthetic continued pretraining
  ☆129Updated 8 months ago
• c-box / KnowledgeLifecycle
  Paper list of "The Life Cycle of Knowledge in Big Language Models: A Survey"
  ☆59Updated 2 years ago
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆83Updated last year
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆51Updated 3 months ago
• Alab-NII / 2wikimultihop
  ☆121Updated 2 years ago
• oriyor / ret-robust
  Implementation of the paper: "Making Retrieval-Augmented Language Models Robust to Irrelevant Context"
  ☆73Updated last year
• pillowsofwind / Knowledge-Conflicts-Survey
  [EMNLP 2024] The official GitHub repo for the survey paper "Knowledge Conflicts for LLMs: A Survey"
  ☆137Updated last year
• princeton-nlp / QuRating
  [ICML 2024] Selecting High-Quality Data for Training Language Models
  ☆187Updated last year
• pldlgb / nuggets
  ☆83Updated last year
• SparkJiao / dpo-trajectory-reasoning
  [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".
  ☆82Updated 8 months ago
• FranxYao / FlanT5-CoT-Specialization
  Implementation of ICML 23 Paper: Specializing Smaller Language Models towards Multi-Step Reasoning.
  ☆131Updated 2 years ago