Implementing scalable LLMs in pure JAX (no third-party libraries)
☆51Jun 11, 2026Updated last month
Alternatives and similar repositories for nanoGPTJAX
Users that are interested in nanoGPTJAX are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Xtructure is datastructure for using in JAX☆23Updated this week
- Code for "What really matters in matrix-whitening optimizers?"☆25Oct 31, 2025Updated 8 months ago
- Fast reinforcement learning 💨☆29Jul 15, 2025Updated last year
- The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size☆19May 19, 2019Updated 7 years ago
- C++-Animation-(Standard-Template-Library)-Engine,or CASTLE for short,is a C++ plotting and animation engine created by BiliBili uploader …☆11Jan 17, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 6,080-param transformer achieving 100% accuracy on 10-digit addition. Trained from scratch in 10 minutes.☆22Feb 19, 2026Updated 5 months ago
- Helper code for the 2021 Kaggle NFL Helmet Assignment Task☆13Sep 22, 2021Updated 4 years ago
- KV Cache & LoRA for minGPT☆61Mar 4, 2026Updated 4 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆199Jan 19, 2026Updated 6 months ago
- Code for "Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining"☆29Oct 14, 2025Updated 9 months ago
- Course on Flash-attention in Triton☆100Feb 9, 2026Updated 5 months ago
- ☆35Jul 5, 2023Updated 3 years ago
- Jax implementation of x-LSTM: Extended Long Short-Term Memory by Beck et al. (2024)☆16Aug 6, 2024Updated last year
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆145May 6, 2026Updated 2 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Supporting code for the blog post on modular manifolds.☆125Sep 26, 2025Updated 9 months ago
- Code for the paper "Stable Gradients for Stable Learning at Scale in Deep Reinforcement Learning". Great performance in many environments…☆39Oct 24, 2025Updated 8 months ago
- Official Code for What Makes and Breaks Safety Fine-tuning? A Mechanistic Study (NeurIPS 2024)☆12Oct 31, 2024Updated last year
- https://github.com/gpu-mode/reference-kernels☆26Jul 4, 2026Updated 2 weeks ago
- A set of Python scripts that makes your experience on TPU better☆56Sep 18, 2025Updated 10 months ago
- Notebooks for IPAM Tutorial, March 15 2019☆24Mar 15, 2019Updated 7 years ago
- ☆15Apr 14, 2025Updated last year
- Global CoT Analysis: Initial attempts to uncover patterns across many chains of thought☆20Feb 10, 2026Updated 5 months ago
- BPE modification that implements removing of the intermediate tokens during tokenizer training.☆27Nov 25, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆37May 11, 2024Updated 2 years ago
- Official implementation of "Reasoning by Superposition: A Theoretical Perspective on Chain of Continuous Thought" (NeurIPS 2025)☆43Oct 8, 2025Updated 9 months ago
- Topology library for Coq☆12Dec 24, 2015Updated 10 years ago
- manim-kindergarten官方网站☆22Dec 21, 2022Updated 3 years ago
- Numerical Optimisation Library☆17Jul 9, 2023Updated 3 years ago
- Flax (Jax) implementation of DeepSeek-R1-Distill-Qwen-1.5B with weights ported from Hugging Face.☆26Feb 20, 2025Updated last year
- ☆21Apr 3, 2026Updated 3 months ago
- ☆13Jul 12, 2024Updated 2 years ago
- ☆18Jun 2, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆16Feb 22, 2026Updated 4 months ago
- Visualization synthesis☆15May 12, 2021Updated 5 years ago
- Minimal yet performant LLM examples in pure JAX☆267Jul 4, 2026Updated 2 weeks ago
- 100M tokens. Infinite compute. Lowest val loss wins.☆514Jul 3, 2026Updated 2 weeks ago
- FlashSampling: Fast and Memory-Efficient Exact Sampling (https://huggingface.co/papers/2603.15854)☆76Jun 15, 2026Updated last month
- World-Gymnast: Training Robots with Reinforcement Learning in a World Model☆44Feb 11, 2026Updated 5 months ago
- A fast and flexible implementation of Rigid Body Dynamics algorithms and their analytical derivatives☆15Dec 21, 2020Updated 5 years ago