A benchmark that challenges language models to code solutions for scientific problems
☆246Oct 26, 2026Updated this week
Alternatives and similar repositories for SciCode
Users that are interested in SciCode are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery☆178Jul 18, 2026Updated 3 months ago
- ☆24Oct 20, 2026Updated last week
- [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆344Jul 13, 2025Updated last year
- VERA: Scaling Verifiable Environments for Agentic co-Evolution — model-harness co-evolution for long-horizon agents☆18Oct 6, 2026Updated 3 weeks ago
- [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI☆106Mar 6, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- GPQA: A Graduate-Level Google-Proof Q&A Benchmark☆545Sep 30, 2024Updated 2 years ago
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"☆970Jul 16, 2025Updated last year
- The supplementary material for the paper "Fine-tuning Large Language Models to Improve Accuracy and Comprehensibility of Automated Code R…☆16Aug 12, 2024Updated 2 years ago
- A benchmark for LLMs on complicated tasks in the terminal☆2,612Jul 11, 2026Updated 3 months ago
- [NeurIPS'24] Official code for *🎯DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving*☆120Dec 10, 2024Updated last year
- ☆14May 16, 2024Updated 2 years ago
- ☆171Oct 20, 2026Updated last week
- The official repository of the Omni-MATH benchmark.☆92Dec 22, 2024Updated last year
- ☆94Oct 22, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- EdgeBench: Unveiling scaling laws of learning from real-world environments☆471Sep 20, 2026Updated last month
- SWE-bench: Can Language Models Resolve Real-world Github Issues?☆6,102Sep 18, 2026Updated last month
- Schema repository for the Alliance of Genome Resources persistent data store☆16Updated this week
- [COLM 2024] Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluation☆15Jul 15, 2024Updated 2 years ago
- Long context evaluation for large language models☆18Jan 23, 2026Updated 9 months ago
- Benchmarking Benchmark Leakage in Large Language Models☆61May 20, 2024Updated 2 years ago
- ☆15Oct 21, 2026Updated last week
- Humanity's Last Exam☆1,734Sep 23, 2026Updated last month
- NaturalCodeBench (Findings of ACL 2024)☆71Oct 14, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆721Mar 16, 2025Updated last year
- ☆13Oct 15, 2026Updated 2 weeks ago
- Discovering Data-driven Hypotheses in the Wild☆165Jun 9, 2025Updated last year
- [NeurIPS 24] Can LLMs Solve Molecule Puzzles? A Multimodal Benchmark for Molecular Structure Elucidation☆21Jan 2, 2026Updated 9 months ago
- ☆13Jul 14, 2024Updated 2 years ago
- [AAAI 2024] SciEval: A Multi-Level Large Language Model Evaluation Benchmark for Scientific Research☆33Aug 6, 2024Updated 2 years ago
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆215Aug 16, 2024Updated 2 years ago
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆609Oct 2, 2026Updated 3 weeks ago
- BERIL Research Observatory - Exploring microbial ecology with the KBase Data Lakehouse☆16Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆85Jan 25, 2025Updated last year
- sparql templates for linkml (alpha)☆12Apr 30, 2022Updated 4 years ago
- Vector Embedding Named Object Model indeX☆12Mar 30, 2026Updated 6 months ago
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆754Jul 29, 2025Updated last year
- ☆42Oct 22, 2026Updated last week
- Code for Trajectory-Level Speculation with Semantic Verification for Tool-Using Agents☆26Oct 16, 2026Updated last week
- Can Language Models Rebuild Programs From Scratch?☆977Oct 12, 2026Updated 2 weeks ago