guestrin-lab / deepscholar-benchLinks
benchmark and evaluate generative research synthesis
☆92Updated 2 weeks ago
Alternatives and similar repositories for deepscholar-bench
Users that are interested in deepscholar-bench are comparing it to the libraries listed below
Sorting:
- Source code for the collaborative reasoner research project at Meta FAIR.☆111Updated 7 months ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆189Updated 9 months ago
- ☆103Updated 8 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆239Updated this week
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆76Updated last year
- Repo for "Adaptation of Agentic AI"☆50Updated this week
- accompanying material for sleep-time compute paper☆118Updated 7 months ago
- Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)☆124Updated 10 months ago
- ☆79Updated 2 months ago
- A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.☆173Updated 2 weeks ago
- Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory☆225Updated 6 months ago
- Analysis code for Neurips 2025 paper "SciArena: An Open Evaluation Platform for Foundation Models in Scientific Literature Tasks"☆55Updated 4 months ago
- XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.☆173Updated 7 months ago
- ☆226Updated 9 months ago
- Super basic implementation (gist-like) of RLMs with REPL environments.☆280Updated last month
- ☆200Updated 2 weeks ago
- (ACL 2025 Main) Code for MultiAgentBench : Evaluating the Collaboration and Competition of LLM agents https://www.arxiv.org/pdf/2503.019…☆192Updated last month
- [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems☆115Updated 6 months ago
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆84Updated 8 months ago
- SiriuS: Self-improving Multi-agent Systems via Bootstrapped Reasoning☆85Updated 2 weeks ago
- Latent Collaboration in Multi-Agent Systems☆564Updated this week
- CodeScientist: An automated scientific discovery system for code-based experiments☆304Updated 2 weeks ago
- ☆63Updated 5 months ago
- Demystifying Reinforcement Learning in Agentic Reasoning☆128Updated 2 months ago
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆94Updated 7 months ago
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆153Updated last year
- ☆96Updated last week
- ☆302Updated 4 months ago
- Official Repo for CRMArena and CRMArena-Pro☆126Updated last month
- Official Code Repository for the paper "Distilling LLM Agent into Small Models with Retrieval and Code Tools"☆177Updated last month