High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)
☆9,327Jul 8, 2025Updated 8 months ago
Alternatives and similar repositories for cleanrl
Users that are interested in cleanrl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PyTorch version of Stable Baselines, reliable implementations of reinforcement learning algorithms.☆12,925Updated this week
- High-quality single-file implementations of SOTA Offline and Offline-to-Online RL algorithms: AWAC, BC, CQL, DT, EDAC, IQL, SAC-N, TD3+BC…☆1,334Aug 3, 2023Updated 2 years ago
- An elegant PyTorch deep reinforcement learning library.☆10,413Dec 1, 2025Updated 3 months ago
- An API standard for single-agent reinforcement learning environments, with popular reference environments and related utilities (formerly…☆11,548Mar 8, 2026Updated 2 weeks ago
- A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.☆3,348Updated this week
- An API standard for multi-agent reinforcement learning environments, with popular reference environments and related utilities☆3,351Feb 6, 2026Updated last month
- A training framework for Stable Baselines3 reinforcement learning agents, with hyperparameter optimization and pre-trained agents include…☆2,745Mar 13, 2026Updated last week
- Really Fast End-to-End Jax RL Implementations☆1,035Sep 9, 2024Updated last year
- RL Environments in JAX 🌍☆871May 30, 2025Updated 9 months ago
- The source code for the blog post The 37 Implementation Details of Proximal Policy Optimization☆927Mar 23, 2024Updated 2 years ago
- C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.☆1,279Aug 12, 2024Updated last year
- An educational resource to help anyone learn deep reinforcement learning.☆11,660Aug 5, 2024Updated last year
- Massively parallel rigidbody physics simulation on accelerator hardware.☆3,094Mar 16, 2026Updated last week
- A collection of reference environments for offline reinforcement learning☆1,663Nov 18, 2024Updated last year
- High-quality single-file implementations of SOTA Offline and Offline-to-Online RL algorithms: AWAC, BC, CQL, DT, EDAC, IQL, SAC-N, TD3+BC…☆631Feb 10, 2024Updated 2 years ago
- LeanRL is a fork of CleanRL, where selected PyTorch scripts optimized for performance using compile and cudagraphs.☆680Aug 22, 2025Updated 7 months ago
- JAX (Flax) implementation of algorithms for Deep Reinforcement Learning with continuous action spaces.☆753Oct 26, 2022Updated 3 years ago
- Isaac Gym Reinforcement Learning Environments☆2,882Oct 26, 2024Updated last year
- Massively Parallel Deep Reinforcement Learning. 🔥☆4,303Feb 20, 2026Updated last month
- A library of reinforcement learning components and agents☆3,946Mar 12, 2026Updated last week
- Simple and easily configurable grid world environments for reinforcement learning☆2,419Mar 2, 2026Updated 3 weeks ago
- Official codebase for Decision Transformer: Reinforcement Learning via Sequence Modeling.☆2,777Apr 29, 2024Updated last year
- High throughput synchronous and asynchronous reinforcement learning☆980Jan 29, 2026Updated last month
- An offline deep reinforcement learning library☆1,648Sep 10, 2025Updated 6 months ago
- Collection of reinforcement learning algorithms☆2,884Jun 17, 2024Updated last year
- OpenAI Baselines: high-quality implementations of reinforcement learning algorithms☆16,677Aug 1, 2024Updated last year
- ☆1,323May 27, 2024Updated last year
- Implementations of basic RL algorithms with minimal lines of codes! (pytorch based)☆3,166Apr 22, 2023Updated 2 years ago
- [NeurIPS'21 Outstanding Paper] Library for reliable evaluation on RL and ML benchmarks, even with only a handful of seeds.☆868Aug 12, 2024Updated last year
- RL implementations☆1,315Mar 14, 2026Updated last week
- Google DeepMind's software stack for physics-based simulation and Reinforcement Learning environments, using MuJoCo.☆4,498Mar 16, 2026Updated last week
- PyTorch implementation of Advantage Actor Critic (A2C), Proximal Policy Optimization (PPO), Scalable trust-region method for deep reinfor…☆3,882May 29, 2022Updated 3 years ago
- Library for Model Based RL☆1,058Jul 12, 2024Updated last year
- ☆1,413Mar 2, 2026Updated 3 weeks ago
- 🕹️ A diverse suite of scalable reinforcement learning environments in JAX☆820Mar 9, 2026Updated 2 weeks ago
- Collections of robotics environments geared towards benchmarking multi-task and meta reinforcement learning☆1,771Jan 20, 2026Updated 2 months ago
- A toolkit for reproducible reinforcement learning research.☆2,088May 4, 2023Updated 2 years ago
- PyTorch implementation of Soft Actor-Critic (SAC), Twin Delayed DDPG (TD3), Actor-Critic (AC/A2C), Proximal Policy Optimization (PPO), QT…☆1,335Mar 13, 2025Updated last year
- Mastering Diverse Domains through World Models☆2,957Sep 23, 2025Updated 6 months ago