yale-nlp / SciArenaLinks
Analysis code for Neurips 2025 paper "SciArena: An Open Evaluation Platform for Foundation Models in Scientific Literature Tasks"
☆54Updated 3 months ago
Alternatives and similar repositories for SciArena
Users that are interested in SciArena are comparing it to the libraries listed below
Sorting:
- Source code for the collaborative reasoner research project at Meta FAIR.☆105Updated 6 months ago
- accompanying material for sleep-time compute paper☆117Updated 6 months ago
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆76Updated 11 months ago
- ☆60Updated 4 months ago
- [EMNLP 2025] The official implementation for paper "Agentic-R1: Distilled Dual-Strategy Reasoning"☆101Updated 2 months ago
- ☆98Updated 7 months ago
- This repository contains expert evaluation interface and data evaluation script for the OpenScholar project.☆28Updated 11 months ago
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆82Updated 7 months ago
- SiriuS: Self-improving Multi-agent Systems via Bootstrapped Reasoning☆72Updated this week
- ☆67Updated 7 months ago
- [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems☆109Updated 5 months ago
- Leveraging Base Language Models for Few-Shot Synthetic Data Generation☆37Updated 3 weeks ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆100Updated this week
- ☆77Updated last week
- ☆40Updated 5 months ago
- Verifiers for LLM Reinforcement Learning☆79Updated 7 months ago
- ☆61Updated 11 months ago
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆91Updated 9 months ago
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆94Updated 6 months ago
- ☆40Updated 11 months ago
- ☆81Updated this week
- The first dense retrieval model that can be prompted like an LM☆89Updated 6 months ago
- Code for ExploreTom☆87Updated 4 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆111Updated 7 months ago
- Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"☆133Updated last year
- Code and data for the paper "Why think step by step? Reasoning emerges from the locality of experience"☆62Updated 7 months ago
- Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)☆122Updated 9 months ago
- Data Synthesis for Deep Research Based on Semi-Structured Data☆177Updated this week
- ☆73Updated last month
- Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles☆59Updated 6 months ago