OpenAI Frontier Evals
☆1,231Apr 21, 2026Updated 2 months ago
Alternatives and similar repositories for frontier-evals
Users that are interested in frontier-evals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repo contains the dataset and code for the paper "SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software E…☆1,437Jul 18, 2025Updated 11 months ago
- MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering☆1,606Apr 24, 2026Updated 2 months ago
- [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆704Mar 16, 2025Updated last year
- ☆4,549Apr 22, 2026Updated 2 months ago
- Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"☆351Nov 10, 2025Updated 7 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- SWE-bench: Can Language Models Resolve Real-world Github Issues?☆5,273Apr 1, 2026Updated 3 months ago
- ☆142Oct 16, 2025Updated 8 months ago
- Democratizing Reinforcement Learning for LLMs☆5,677Updated this week
- Our library for RL environments + evals☆4,254Updated this week
- MLGym A New Framework and Benchmark for Advancing AI Research Agents☆610Aug 10, 2025Updated 10 months ago
- Simple RL training for reasoning☆3,867Dec 23, 2025Updated 6 months ago
- verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework☆22,173Jun 27, 2026Updated last week
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆696Jul 29, 2025Updated 11 months ago
- AllenAI's post-training codebase☆3,775Jun 27, 2026Updated last week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- s1: Simple test-time scaling☆6,658Jun 25, 2025Updated last year
- Sky-T1: Train your own O1 preview model within $450☆3,392Jul 12, 2025Updated 11 months ago
- Official Repo for Open-Reasoner-Zero☆2,096Jun 2, 2025Updated last year
- An Open-source RL System from ByteDance Seed and Tsinghua AIR☆1,838May 11, 2025Updated last year
- Fully open reproduction of DeepSeek-R1☆26,381Apr 2, 2026Updated 3 months ago
- The RL Bridge for LLM-based Agent Applications. Made Simple & Flexible.☆5,469Updated this week
- Pretraining and inference code for a large-scale depth-recurrent language model☆896Dec 29, 2025Updated 6 months ago
- Minimal reproduction of DeepSeek R1-Zero☆13,182Feb 27, 2026Updated 4 months ago
- ☆98Oct 30, 2025Updated 8 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆1,160Jan 10, 2026Updated 5 months ago
- Fully open data curation for reasoning models☆2,295Dec 2, 2025Updated 7 months ago
- [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents☆688Updated this week
- [ICML '24] R2E: Turn any GitHub Repository into a Programming Agent Environment☆148Apr 20, 2025Updated last year
- ☆811Jun 9, 2025Updated last year
- RAGEN leverages reinforcement learning to train LLM reasoning agents in interactive, stochastic environments.☆2,734Apr 14, 2026Updated 2 months ago
- Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.☆18,783Apr 14, 2026Updated 2 months ago
- Train transformer language models with reinforcement learning.☆18,735Updated this week
- Lightweight coding agent that runs in your terminal☆94,569Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI☆106Mar 6, 2025Updated last year
- [NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards☆1,458Apr 17, 2026Updated 2 months ago
- Muon is Scalable for LLM Training☆1,498Aug 3, 2025Updated 11 months ago
- Collections of RLxLM experiments using minimal codes☆14Feb 17, 2025Updated last year
- [COLM 2025] Code for Paper: Learning Adaptive Parallel Reasoning with Language Models☆144Dec 17, 2025Updated 6 months ago
- The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search☆6,765Dec 19, 2025Updated 6 months ago
- Search-R1: An Efficient, Scalable RL Training Framework for Reasoning & Search Engine Calling interleaved LLM based on veRL☆5,051Nov 13, 2025Updated 7 months ago