One RL training loop that runs CartPole on a laptop and disaggregated async RLVR on a GPU cluster. About 1,800 lines across 7 files. No Ray, no TRL, no DeepSpeed. It's small enough to read in an afternoon, and it's meant to be forked, not imported.
☆13Oct 8, 2026Updated 3 weeks ago
Alternatives and similar repositories for nanoRL
Users that are interested in nanoRL are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code for paper "Understanding Generalization, Robustness, and Interpretability in Low-Capacity Neural Networks"☆13Jul 24, 2025Updated last year
- A small indecis model plays ViZDoom's defend_the_center☆13Oct 1, 2026Updated 3 weeks ago
- 《Command: Modern Operations（现代行动 ：指挥）》全量深度非侵入式中文本地化开源工程☆26Updated this week
- A C++ multi-dimensional tensor library with automatic gradient tracking and CUDA acceleration.☆13Aug 9, 2026Updated 2 months ago
- A template for intelligent air-to-air battle game using OpenAI stablebaselines3, jsbsim and flightgear.☆14Apr 16, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Heterogeneous Hierarchical Multi Agent Reinforcement Learning for Realistic Air Combat☆25Jun 23, 2026Updated 4 months ago
- A Rust implementation of basic reinforcement learning algorithms with minimal codes☆11Oct 19, 2025Updated last year
- LocusTether is a self-hosted replacement for the Omi wearable's normal cloud pipeline. Omi's official app streams your audio to Omi's ser…☆17Sep 1, 2026Updated last month
- Agentic skill to create a hill to climb for every problem☆22Sep 30, 2026Updated 3 weeks ago
- Mosaic trees managment tool and library☆14Nov 17, 2015Updated 10 years ago
- This tool connects DVC (https://dvc.org/) to CC (www.curious-containers.cc) to run your defined stages with DVC in a docker on your cloud…☆11May 7, 2020Updated 6 years ago
- ☆18Oct 8, 2026Updated 3 weeks ago
- [COLM '24] Source-Aware Training Enables Knowledge Attribution in Language Models☆23Apr 1, 2025Updated last year
- Adaptation of titans-pytorch to llama models on HF☆26Mar 6, 2025Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ASCII canvas for drawing in console☆12Nov 7, 2017Updated 8 years ago
- The TacticalAPI is an interface from Rheinmetall providing access to situational awareness systems☆41Sep 1, 2026Updated last month
- A CUDA Python experiment demonstrating kernel fusion by combining ReLU and LayerNorm into a single GPU pass and comparing it against the …☆14Feb 28, 2026Updated 8 months ago
- Integrates Imbue's Cost Aware pareto-Region Bayesian Search (CARBS) with Weights and Biases (WanDB)☆12Mar 17, 2025Updated last year
- A free alternative to the Omi app!☆33Feb 17, 2026Updated 8 months ago
- A place to store relevant research papers and resources☆14Apr 8, 2025Updated last year
- Language-specific restylers☆22Updated this week
- An unofficial implementation of MEME (Efficient Memory-based Exploration agent) from DeepMind☆11Apr 13, 2024Updated 2 years ago
- A ground-up, native-Rust reimplementation of the entire Lean 4 toolchain — drop-in at the binary surfaces (.olean, C ABI, LSP, CLI), dete…☆25Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Cross-platform AI companion port of OpenClicky for Windows, Linux, and macOS.☆31Oct 20, 2026Updated last week
- Binary storage format for deep learning on videos.☆12Mar 10, 2022Updated 4 years ago
- Autonomous agent loops for Hermes Agent: the autoresearch harness and the health/improvement maintenance loops.☆31Aug 13, 2026Updated 2 months ago
- A reinforcement learning library for rust☆28Updated this week
- Build a graph of citations from annotated BibTeX files.☆14Jan 22, 2018Updated 8 years ago
- Official release of the CLVR Jaco Play Dataset, Dass et al. 2023☆17Apr 24, 2023Updated 3 years ago
- Code and data accompaning the paper "Learning State Representations with Robotic Priors" (Jonschkowski and Brock, 2015).☆18Nov 14, 2017Updated 8 years ago
- protobuf support for setuptools☆17Sep 29, 2026Updated last month
- CUAI's RL/interactive learning reading group website + materials :)☆39Oct 20, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- This is a simple automated license plate detector developed in C++ via OpenCV.☆11Sep 26, 2020Updated 6 years ago
- Demo of fine-tuning QA models for answering FAQ of cloud providers documentation☆11Jun 20, 2026Updated 4 months ago
- DVC integration plugin for Intellij IDEs including PyCharm, IntelliJ IDEA and CLion☆17Jun 22, 2022Updated 4 years ago
- Tokenize and clean strings in Python☆11Jan 11, 2018Updated 8 years ago
- Experimental validation: Agentic Search (context trees) vs traditional RAG for code retrieval. Agentic wins with 99% fewer tokens and 2× …☆13Jan 6, 2026Updated 9 months ago
- Lightweight OpenAI wrapper using FastAPI. Add rate limits to OpenAI usage, optionally log and store all API calls, and share regulated Op…☆15Feb 15, 2024Updated 2 years ago
- A Unix backend for Ibis☆11Jul 11, 2024Updated 2 years ago