A benchmark that challenges language models to code solutions for scientific problems
☆246Nov 16, 2026Updated this week
Alternatives and similar repositories for SciCode
Users that are interested in SciCode are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery☆185Updated this week
- ☆24Oct 20, 2026Updated 3 weeks ago
- [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆353Jul 13, 2025Updated last year
- [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI☆106Mar 6, 2025Updated last year
- The supplementary material for the paper "Fine-tuning Large Language Models to Improve Accuracy and Comprehensibility of Automated Code R…☆16Aug 12, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- GPQA: A Graduate-Level Google-Proof Q&A Benchmark☆551Sep 30, 2024Updated 2 years ago
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"☆978Jul 16, 2025Updated last year
- A benchmark for LLMs on complicated tasks in the terminal☆2,623Jul 11, 2026Updated 4 months ago
- ☆17Updated this week
- The official repository of the Omni-MATH benchmark.☆93Dec 22, 2024Updated last year
- ☆171Oct 20, 2026Updated 3 weeks ago
- [NeurIPS'24] Official code for *🎯DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving*☆121Dec 10, 2024Updated last year
- ☆98Nov 3, 2026Updated 2 weeks ago
- VERA: Scaling Verifiable Environments for Agentic co-Evolution — model-harness co-evolution for long-horizon agents☆23Oct 6, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- EdgeBench: Unveiling scaling laws of learning from real-world environments☆482Nov 6, 2026Updated last week
- [COLM 2024] Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluation☆15Jul 15, 2024Updated 2 years ago
- Long context evaluation for large language models☆18Jan 23, 2026Updated 9 months ago
- Humanity's Last Exam☆1,748Sep 23, 2026Updated last month
- SWE-bench: Can Language Models Resolve Real-world Github Issues?☆6,216Sep 18, 2026Updated 2 months ago
- Examples showing best practices for using Coq notations and custom entries [maintainer=@bcpierce00]☆12Feb 2, 2024Updated 2 years ago
- Benchmarking Benchmark Leakage in Large Language Models☆61May 20, 2024Updated 2 years ago
- [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆722Mar 16, 2025Updated last year
- ☆14May 16, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- NaturalCodeBench (Findings of ACL 2024)☆71Oct 14, 2024Updated 2 years ago
- [NeurIPS 24] Can LLMs Solve Molecule Puzzles? A Multimodal Benchmark for Molecular Structure Elucidation☆21Jan 2, 2026Updated 10 months ago
- Discovering Data-driven Hypotheses in the Wild☆167Jun 9, 2025Updated last year
- ☆13Jul 14, 2024Updated 2 years ago
- [AAAI 2024] SciEval: A Multi-Level Large Language Model Evaluation Benchmark for Scientific Research☆33Aug 6, 2024Updated 2 years ago
- ☆85Jan 25, 2025Updated last year
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆214Aug 16, 2024Updated 2 years ago
- Vector Embedding Named Object Model indeX☆12Mar 30, 2026Updated 7 months ago
- ☆42Oct 22, 2026Updated 3 weeks ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆16Nov 11, 2026Updated last week
- Replicating O1 inference-time scaling laws☆94Dec 1, 2024Updated last year
- Resources for the Enigmata Project.☆86Aug 13, 2025Updated last year
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆625Updated this week
- [COLM 2026] MegaScience: Pushing the Frontiers of Post-Training Datasets for Science Reasoning☆133Jul 9, 2026Updated 4 months ago
- Collation of metadata examples and notes for the project☆12Apr 16, 2026Updated 7 months ago
- Can Language Models Rebuild Programs From Scratch?☆982Nov 11, 2026Updated last week
Are these results useful?