guestrin-lab / deepscholar-benchLinks
benchmark and evaluate generative research synthesis
☆103Updated last week
Alternatives and similar repositories for deepscholar-bench
Users that are interested in deepscholar-bench are comparing it to the libraries listed below
Sorting:
- Source code for the collaborative reasoner research project at Meta FAIR.☆111Updated 8 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆249Updated last week
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆190Updated 9 months ago
- Repo for "Adaptation of Agentic AI"☆522Updated 2 weeks ago
- Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.☆64Updated 8 months ago
- ☆79Updated 3 months ago
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆85Updated 9 months ago
- ☆226Updated 10 months ago
- [EMNLP 2025 Demo] TinyScientist: A Lightweight Framework for Building Research Agents☆124Updated 2 months ago
- ☆104Updated 9 months ago
- Training teachers with reinforcement learning able to make LLMs learn how to reason for test time scaling.☆355Updated 6 months ago
- A framework for fine-tuning retrieval-augmented generation (RAG) systems.☆137Updated 2 weeks ago
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆76Updated last year
- Super basic implementation (gist-like) of RLMs with REPL environments.☆293Updated 2 months ago
- [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems☆119Updated 6 months ago
- Library for text-to-text regression, applicable to any input string representation and allows pretraining and fine-tuning over multiple r…☆304Updated 3 weeks ago
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆94Updated 7 months ago
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆153Updated last year
- Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)☆126Updated 10 months ago
- ☆68Updated 7 months ago
- accompanying material for sleep-time compute paper☆118Updated 8 months ago
- OpenTinker is an RL-as-a-Service infrastructure for foundation models☆499Updated this week
- A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.☆173Updated this week
- ☆317Updated 5 months ago
- Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory☆231Updated 7 months ago
- Analysis code for Neurips 2025 paper "SciArena: An Open Evaluation Platform for Foundation Models in Scientific Literature Tasks"☆55Updated 5 months ago
- Curated collection of community environments☆196Updated 2 weeks ago
- Leveraging Base Language Models for Few-Shot Synthetic Data Generation☆40Updated 2 months ago
- Demystifying Reinforcement Learning in Agentic Reasoning☆139Updated 2 months ago
- Data recipes and robust infrastructure for training AI agents☆75Updated this week