One RL training loop that runs CartPole on a laptop and disaggregated async RLVR on a GPU cluster. About 1,800 lines across 7 files. No Ray, no TRL, no DeepSpeed. It's small enough to read in an afternoon, and it's meant to be forked, not imported.
☆13Oct 8, 2026Updated last month
Alternatives and similar repositories for nanoRL
Users that are interested in nanoRL are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- METIS-Core: A C++ Reinforcement Learning Framework☆17Updated this week
- Code for paper "Understanding Generalization, Robustness, and Interpretability in Low-Capacity Neural Networks"☆13Jul 24, 2025Updated last year
- The first reinforcement learning agent to finish Getting Over It with Bennett Foddy in one continuous run☆53Nov 5, 2026Updated last week
- A small indecis model plays ViZDoom's defend_the_center☆13Oct 1, 2026Updated last month
- A teaching sandbox for military history: put a campaign on a real map, + then watch the decisions play out round by round.☆17Oct 18, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 通过自然语言描述场景,自动生成 CMO可运行的 Lua 代码/Generate runnable Command: Modern Operations Lua scripts from natural language descriptions.☆12May 23, 2026Updated 5 months ago
- ☆13Nov 10, 2026Updated last week
- A Rust implementation of basic reinforcement learning algorithms with minimal codes☆11Oct 19, 2025Updated last year
- Mosaic trees managment tool and library☆14Nov 17, 2015Updated 11 years ago
- This tool connects DVC (https://dvc.org/) to CC (www.curious-containers.cc) to run your defined stages with DVC in a docker on your cloud…☆11May 7, 2020Updated 6 years ago
- A C++ multi-dimensional tensor library with automatic gradient tracking and CUDA acceleration.☆13Aug 9, 2026Updated 3 months ago
- A template for intelligent air-to-air battle game using OpenAI stablebaselines3, jsbsim and flightgear.☆14Apr 16, 2024Updated 2 years ago
- ASCII canvas for drawing in console☆12Nov 7, 2017Updated 9 years ago
- PPO (Proximal Policy Optimization) agent for training on Atari environments using C++ with libtorch, integrated with the Arcade Learning …☆10Jun 14, 2026Updated 5 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆10Aug 20, 2025Updated last year
- JAX implementation of NeuroEvolution of Augmenting Topologies (Neat)☆11Jul 6, 2024Updated 2 years ago
- ☆15Updated this week
- Integrates Imbue's Cost Aware pareto-Region Bayesian Search (CARBS) with Weights and Biases (WanDB)☆12Mar 17, 2025Updated last year
- A place to store relevant research papers and resources☆14Apr 8, 2025Updated last year
- Language-specific restylers☆22Updated this week
- An unofficial implementation of MEME (Efficient Memory-based Exploration agent) from DeepMind☆11Apr 13, 2024Updated 2 years ago
- [COLM '24] Source-Aware Training Enables Knowledge Attribution in Language Models☆23Apr 1, 2025Updated last year
- Binary storage format for deep learning on videos.☆12Mar 10, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Headless Warcraft III (Legacy TFT 1.29) under Wine for reinforcement learning: the real game stepped from Python, with PufferLib 5 traini…☆32Updated this week
- Build a graph of citations from annotated BibTeX files.☆14Jan 22, 2018Updated 8 years ago
- Official release of the CLVR Jaco Play Dataset, Dass et al. 2023☆17Apr 24, 2023Updated 3 years ago
- LocusTether is a self-hosted replacement for the Omi wearable's normal cloud pipeline. Omi's official app streams your audio to Omi's ser…☆17Sep 1, 2026Updated 2 months ago
- Adaptation of titans-pytorch to llama models on HF☆26Mar 6, 2025Updated last year
- Code and data accompaning the paper "Learning State Representations with Robotic Priors" (Jonschkowski and Brock, 2015).☆18Nov 14, 2017Updated 9 years ago
- This is a simple automated license plate detector developed in C++ via OpenCV.☆11Sep 26, 2020Updated 6 years ago
- DVC integration plugin for Intellij IDEs including PyCharm, IntelliJ IDEA and CLion☆17Jun 22, 2022Updated 4 years ago
- ☆17Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Tokenize and clean strings in Python☆11Jan 11, 2018Updated 8 years ago
- Demo of fine-tuning QA models for answering FAQ of cloud providers documentation☆11Jun 20, 2026Updated 4 months ago
- Lightweight OpenAI wrapper using FastAPI. Add rate limits to OpenAI usage, optionally log and store all API calls, and share regulated Op…☆15Feb 15, 2024Updated 2 years ago
- A CUDA Python experiment demonstrating kernel fusion by combining ReLU and LayerNorm into a single GPU pass and comparing it against the …☆14Feb 28, 2026Updated 8 months ago
- A Unix backend for Ibis☆11Jul 11, 2024Updated 2 years ago
- Streaming Retrieval-Augmented Generation (RAG) agent in Go. It consumes real-time data from Kafka topics, processes it in configurable wi…☆27Jun 7, 2025Updated last year
- This is a project for creating and using IL datasets based on HuggingFace weights with multithreads for performance, and benchmarking☆13Oct 30, 2026Updated 2 weeks ago
Are these results useful?