Alternatives and similar repositories for OmniEval:

Users that are interested in OmniEval are comparing it to the libraries listed below

• dongguanting / FollowRAG
  The demo, code and data of FollowRAG
  ☆70Updated 3 months ago
• 8421BCD / fullrank
  ☆21Updated 2 months ago
• meowpass / FollowComplexInstruction
  Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…
  ☆46Updated 8 months ago
• dongguanting / DPA-RAG
  The code and data of DPA-RAG
  ☆57Updated 2 months ago
• Ariya12138 / CORAL
  ☆46Updated last month
• weizhepei / InstructRAG
  [ICLR 2025] InstructRAG: Instructing Retrieval-Augmented Generation via Self-Synthesized Rationales
  ☆78Updated last month
• thunlp / Adaptive-Note
  ☆53Updated 5 months ago
• xlang-ai / BRIGHT
  BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
  ☆89Updated last month
• MozerWang / Loong
  [EMNLP 2024 (Oral)] Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA
  ☆116Updated 4 months ago
• Junjie-Ye / ToolEyes
  [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios
  ☆66Updated 3 months ago
• ZitongYang / Synthetic_Continued_Pretraining
  Code implementation of synthetic continued pretraining
  ☆94Updated 2 months ago
• THUDM / LongReward
  ☆54Updated 4 months ago
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆79Updated last year
• yyDing1 / ScaleQuest
  We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.
  ☆60Updated 4 months ago
• RuochenZhao / Verify-and-Edit
  A framework for editing the CoTs for better factuality
  ☆49Updated last year
• RUCAIBox / LLM-Knowledge-Boundary
  Implementation of "Investigating the Factual Knowledge Boundary of Large Language Models with Retrieval Augmentation"
  ☆79Updated last year
• plageon / SlimPlm
  Small Models, Big Insights: Leveraging Slim Proxy Models To Decide When and What to Retrieve for LLMs (ACL 2024)
  ☆59Updated 5 months ago
• FlagOpen / Infinity-Instruct
  ☆45Updated 9 months ago
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆45Updated 2 months ago
• StonyBrookNLP / ircot
  Repository for Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions, ACL23
  ☆194Updated 9 months ago
• Abbey4799 / CELLO
  Code and data for the paper "Can Large Language Models Understand Real-World Complex Instructions?"(AAAI2024)
  ☆47Updated 11 months ago
• OpenMatch / Augmentation-Adapted-Retriever
  [ACL 2023] This is the code repo for our ACL'23 paper "Augmentation-Adapted Retriever Improves Generalization of Language Models as Gener…
  ☆60Updated 8 months ago
• OpenMatch / RAG-DDR
  [ICLR 2025] This is the code repo for our ICLR’25 paper "RAG-DDR: Optimizing Retrieval-Augmented Generation Using Differentiable Data Rew…
  ☆29Updated last month
• qhjqhj00 / WebBrain
  ☆67Updated last year
• zexuanqiu / CLongEval
  CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models
  ☆40Updated last year
• yuleiqin / fantastic-data-engineering
  Fantastic Data Engineering for Large Language Models
  ☆83Updated 2 months ago
• tianyi-lab / Superfiltering
  [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning
  ☆147Updated 6 months ago
• GAIR-NLP / ReAlign
  Reformatted Alignment
  ☆115Updated 5 months ago