RUC-NLPIR / OmniEval
Open source code of the paper: "OmniEval: An Omnidirectional and Automatic RAG Evaluation Benchmark in Financial Domain"
β55Updated 3 months ago
Alternatives and similar repositories for OmniEval:
Users that are interested in OmniEval are comparing it to the libraries listed below
- The demo, code and data of FollowRAGβ71Updated 4 months ago
- π WebThinker: Empowering Large Reasoning Models with Deep Research Capabilityβ120Updated this week
- CORAL: Benchmarking Multi-turn Conversational Retrieval-Augmentation Generationβ47Updated last month
- The code and data of DPA-RAGβ58Updated 2 months ago
- β22Updated 3 months ago
- Small Models, Big Insights: Leveraging Slim Proxy Models To Decide When and What to Retrieve for LLMs (ACL 2024)β62Updated last week
- [ICLR 2025] InstructRAG: Instructing Retrieval-Augmented Generation via Self-Synthesized Rationalesβ81Updated 2 months ago
- [EMNLP 2024 (Oral)] Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QAβ122Updated 5 months ago
- [Neurips2024] Source code for xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Tokenβ133Updated 9 months ago
- The GitHub repository for the paper "Self-prompted Chain-of-Thought on Large Language Models for Open-domain Multi-hop Reasoning" accepteβ¦β18Updated last year
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenariosβ65Updated 4 months ago
- Official github repo for AutoDetect, an automated weakness detection framework for LLMs.β42Updated 9 months ago
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large Lβ¦β46Updated 9 months ago
- AutoCoA (Automatic generation of Chain-of-Action) is an agent model framework that enhances the multi-turn tool usage capability of reasoβ¦β89Updated 3 weeks ago
- [EMNLP 2024] The official GitHub repo for the survey paper "Knowledge Conflicts for LLMs: A Survey"β111Updated 6 months ago
- Repository for Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions, ACL23β201Updated 10 months ago
- BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrievalβ95Updated 2 months ago
- A framework for editing the CoTs for better factualityβ50Updated last year
- β101Updated 4 months ago
- Code Repo for EfficientRAG: Efficient Retriever for Multi-Hop Question Answeringβ44Updated last month
- Code implementation of synthetic continued pretrainingβ99Updated 3 months ago
- PGRAGβ48Updated 8 months ago
- We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.β61Updated 5 months ago
- The code of arxiv paper: "CoT-based Synthesizer: Enhancing LLM Performance through Answer Synthesis"β23Updated 3 months ago
- CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Modelsβ41Updated last year
- [ICLR 2025] This is the code repo for our ICLRβ25 paper "RAG-DDR: Optimizing Retrieval-Augmented Generation Using Differentiable Data Rewβ¦β33Updated 2 months ago
- β55Updated 5 months ago
- Code for Search-in-the-Chain: Towards Accurate, Credible and Traceable Large Language Models for Knowledge-intensive Tasksβ55Updated last year
- Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)β76Updated last month
- Reformatted Alignmentβ115Updated 6 months ago