scicode-bench / SciCodeLinks
A benchmark that challenges language models to code solutions for scientific problems
☆123Updated this week
Alternatives and similar repositories for SciCode
Users that are interested in SciCode are comparing it to the libraries listed below
Sorting:
- Can Language Models Solve Olympiad Programming?☆116Updated 4 months ago
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆169Updated this week
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆173Updated 2 months ago
- A simple unified framework for evaluating LLMs☆215Updated last month
- ☆114Updated 3 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆223Updated 7 months ago
- Replicating O1 inference-time scaling laws☆87Updated 6 months ago
- SWE Arena☆33Updated last month
- ☆174Updated last month
- Repository for the paper Stream of Search: Learning to Search in Language☆147Updated 4 months ago
- Implementation of the Quiet-STAR paper (https://arxiv.org/pdf/2403.09629.pdf)☆54Updated 9 months ago
- Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"☆107Updated last year
- Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆73Updated last month
- A virtual environment for developing and evaluating automated scientific discovery agents.☆156Updated 2 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆172Updated 4 months ago
- CodeUltraFeedback: aligning large language models to coding preferences☆71Updated 11 months ago
- 🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…☆206Updated 3 weeks ago
- ☆83Updated last month
- Code and example data for the paper: Rule Based Rewards for Language Model Safety☆187Updated 10 months ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆136Updated 6 months ago
- [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples☆88Updated last week
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆89Updated 6 months ago
- ☆97Updated 11 months ago
- Scaling Data for SWE-agents☆220Updated this week
- ☆29Updated 3 weeks ago
- The official repo for "TheoremQA: A Theorem-driven Question Answering dataset" (EMNLP 2023)☆32Updated last year
- [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery☆88Updated last month
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆54Updated last year
- B-STAR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners☆82Updated 2 weeks ago
- Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory☆61Updated last week