A benchmark for evaluating LLMs on open-ended CS problems. Exploring the Next Frontier of Computer Science.
☆331Oct 3, 2026Updated 2 weeks ago
Alternatives and similar repositories for Frontier-CS
Users that are interested in Frontier-CS are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- FrontierSmith, a new system that uses AI to synthesize open-ended coding problems at scale☆83Updated this week
- AI-Driven Scientific, Algorithmic, and Systems Discovery☆718Sep 14, 2026Updated last month
- ThetaEvolve: Test-time Learning on Open Problems, enabling RL training on AlphaEvolve/OpenEvolve and emphasizing scaling test-time comput…☆182Feb 27, 2026Updated 7 months ago
- ☆24Dec 6, 2025Updated 10 months ago
- AI agent benchmark hackability scanner — find evaluation vulnerabilities before they undermine your results☆48May 25, 2026Updated 4 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [NeurIPS '25] GSO: Challenging Software Optimization Tasks for Evaluating SWE-Agents☆92Sep 29, 2026Updated 2 weeks ago
- Advancing the frontier of efficient AI☆69Oct 1, 2026Updated 2 weeks ago
- SkyRL: A Modular Full-stack RL Library for LLMs☆2,427Updated this week
- Building the Virtuous Cycle for AI-driven LLM Systems☆295Sep 25, 2026Updated 3 weeks ago
- [AAAI26]: DS SERVE: The Largest Open Vector Store over Pretain Data; A Framework for Efficient and Scalable Neural Retrieval☆56Jan 28, 2026Updated 8 months ago
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆598Oct 2, 2026Updated 2 weeks ago
- The official repository of ALE-Bench☆226Updated this week
- AlgoTune is a NeurIPS 2025 benchmark made up of 154 math, physics, and computer science problems. The goal is write code that solves each…☆118Jun 24, 2026Updated 3 months ago
- Automated High-Performance GPU Kernel Generation☆142Jun 1, 2026Updated 4 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆649May 24, 2026Updated 4 months ago
- Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.☆3,149Updated this week
- Official Repository of VisGym: Diverse, Customizable, Scalable Environments for Multimodal Agents☆117May 3, 2026Updated 5 months ago
- PhD/MBA-level human-annotated rubrics dataset across Physics, Chemistry, Finance and Consulting☆34Oct 30, 2025Updated 11 months ago
- ☆20Sep 16, 2025Updated last year
- [NeurIPS 2025 D&B Track] MLR-Bench: Evaluating AI Agents on Open-Ended Machine Learning Research☆36Sep 8, 2026Updated last month
- AI-Driven Research Systems (ADRS)☆160Dec 17, 2025Updated 10 months ago
- Vortex: Programmable Sparse Attention for Agents as Algorithm Designers☆69Aug 22, 2026Updated last month
- Open-source autoresearch powered by autonomous coding agents. Run Claude Code, OpenCode, and Codex with grading, shared knowledge, and mu…☆1,074Sep 8, 2026Updated last month
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Preview Code for Continuum Paper☆110Aug 13, 2026Updated 2 months ago
- [ICLR 2026]InnovatorBench: Evaluating Agents' Ability to Conduct Innovative LLM Research☆17Feb 3, 2026Updated 8 months ago
- [ACL'25] UTBoost: Rigorous Evaluation of Coding Agents on SWE-Bench☆36Aug 12, 2025Updated last year
- FrontierSWE is an ultra long-horizon coding agent benchmark that tests implementation, performance eng and ML research☆233Aug 13, 2026Updated 2 months ago
- Official eval scripts for JobBench☆58Oct 6, 2026Updated last week
- Continual Learning Bench☆230Jul 19, 2026Updated 2 months ago
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs)☆1,293Mar 24, 2026Updated 6 months ago
- mKernel: fast multi-node, multi-GPU fused kernels☆297Updated this week
- [ICML 2026] SWE-ABS: Adversarial Benchmark Strengthening Exposes Inflated Success Rates on Test-based Benchmark☆25May 6, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆122Oct 6, 2026Updated last week
- A general framework for strategically scaling evaluation-driven discovery loops, discovering state-of-the-art solutions on 21 open-ended …☆186Aug 20, 2026Updated last month
- A toolkit for testing and improving named entity recognition [ESEC/FSE'23]☆11Aug 31, 2023Updated 3 years ago
- LM engine is a library for pretraining/finetuning LLMs☆196Sep 25, 2026Updated 3 weeks ago
- Framework for evaluating and improving agents☆6,195Updated this week
- Open-source implementation of AlphaEvolve☆7,576Updated this week
- A curated list of awesome Harbor ecosystem projects☆58May 29, 2026Updated 4 months ago