guestrin-lab / deepscholar-benchLinks
benchmark and evaluate generative research synthesis
☆63Updated last week
Alternatives and similar repositories for deepscholar-bench
Users that are interested in deepscholar-bench are comparing it to the libraries listed below
Sorting:
- XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.☆168Updated 5 months ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆188Updated 7 months ago
- Source code for the collaborative reasoner research project at Meta FAIR.☆103Updated 6 months ago
- accompanying material for sleep-time compute paper☆117Updated 6 months ago
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆147Updated last year
- ☆231Updated 4 months ago
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆76Updated 10 months ago
- ☆146Updated last year
- ☆59Updated 9 months ago
- Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)☆120Updated 8 months ago
- A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.☆169Updated this week
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- ☆62Updated 3 months ago
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆93Updated 5 months ago
- Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.☆57Updated 5 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆99Updated this week
- ☆79Updated last month
- ☆96Updated 7 months ago
- Super basic implementation (gist-like) of RLMs with REPL environments.☆204Updated 2 weeks ago
- Large Language Model (LLM) powered evaluator for Retrieval Augmented Generation (RAG) pipelines.☆31Updated last year
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆216Updated last week
- Train your own SOTA deductive reasoning model☆109Updated 7 months ago
- Official repository for paper "ReasonIR Training Retrievers for Reasoning Tasks".☆205Updated 4 months ago
- Repository for the paper Stream of Search: Learning to Search in Language☆151Updated 8 months ago
- A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments☆92Updated 3 weeks ago
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆120Updated this week
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆254Updated last week
- Leveraging Base Language Models for Few-Shot Synthetic Data Generation☆36Updated last week
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆79Updated 7 months ago
- A framework for optimizing DSPy programs with RL☆214Updated this week