yale-nlp / SciArenaLinks
Analysis code for paper "SciArena: An Open Evaluation Platform for Foundation Models in Scientific Literature Tasks"
☆47Updated 2 weeks ago
Alternatives and similar repositories for SciArena
Users that are interested in SciArena are comparing it to the libraries listed below
Sorting:
- ☆54Updated last month
- accompanying material for sleep-time compute paper☆104Updated 3 months ago
- ☆40Updated 8 months ago
- Source code for the collaborative reasoner research project at Meta FAIR.☆101Updated 4 months ago
- ☆66Updated 4 months ago
- The official implementation for paper "Agentic-R1: Distilled Dual-Strategy Reasoning"☆92Updated last month
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆92Updated 7 months ago
- SiriuS: Self-improving Multi-agent Systems via Bootstrapped Reasoning☆61Updated last month
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆87Updated last week
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆111Updated 4 months ago
- Simple examples using Argilla tools to build AI☆53Updated 9 months ago
- ☆59Updated 8 months ago
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆73Updated 5 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 6 months ago
- Verifiers for LLM Reinforcement Learning☆70Updated 4 months ago
- ☆77Updated 2 weeks ago
- [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems☆101Updated 2 months ago
- ☆54Updated 9 months ago
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆73Updated 8 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆33Updated 4 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆84Updated 5 months ago
- A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments☆88Updated 10 months ago
- ☆48Updated 10 months ago
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆60Updated 8 months ago
- Code and data for the paper "Why think step by step? Reasoning emerges from the locality of experience"☆61Updated 4 months ago
- LLM reads a paper and produce a working prototype☆57Updated 4 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆33Updated 4 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated 11 months ago
- Official Repo for CRMArena and CRMArena-Pro☆107Updated last month
- ☆37Updated 2 months ago