Implementing scalable LLMs in pure JAX (no third-party libraries)
☆56Nov 9, 2026Updated last week
Alternatives and similar repositories for nanoGPTJAX
Users that are interested in nanoGPTJAX are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Deriving steepest descent convergence bounds and hyperparameter scaling laws in machine learning optimization from first principles, form…☆18Apr 11, 2026Updated 7 months ago
- Official Repository of Paper "Watch the Weights: Unsupervised monitoring and control of fine-tuned LLMs"☆15Sep 25, 2025Updated last year
- Working Group on Becoming Full-Stack AI Researchers (Fall 2025 - Fall 2026)☆11May 12, 2026Updated 6 months ago
- ☆15Sep 29, 2022Updated 4 years ago
- Code for Looped Transformers for Length Generalization (https://arxiv.org/abs/2409.15647), ICLR 2025☆15Apr 30, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Official code for the paper Scale leads to compositional generalization.☆13Jul 11, 2025Updated last year
- A code repository accompanying the paper "Transformers, parallel computation, and logarithmic depth" by Clayton Sanford, Daniel Hsu, and …☆12Feb 15, 2024Updated 2 years ago
- ☆11Jul 27, 2025Updated last year
- Code for the Transform 2020 Tutorial on Ray!☆12Jun 12, 2020Updated 6 years ago
- Flax (JAX) implementation of Progressive Growing of GANs for Improved Quality, Stability, and Variation☆12May 24, 2021Updated 5 years ago
- Xtructure is datastructure for using in JAX☆24Updated this week
- Code for "What really matters in matrix-whitening optimizers?"☆25Oct 31, 2025Updated last year
- Reproducing GPT on the TinyStories dataset☆22Jan 18, 2024Updated 2 years ago
- The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size☆19May 19, 2019Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆42Feb 18, 2025Updated last year
- C++-Animation-(Standard-Template-Library)-Engine,or CASTLE for short,is a C++ plotting and animation engine created by BiliBili uploader …☆11Jan 17, 2021Updated 5 years ago
- Generating Synthetic Lifelong RL Data for LLMs at Scale☆14Jul 9, 2026Updated 4 months ago
- 6,080-param transformer achieving 100% accuracy on 10-digit addition. Trained from scratch in 10 minutes.☆22Feb 19, 2026Updated 9 months ago
- ☆11Mar 13, 2021Updated 5 years ago
- Code for "Matching Features, Not Tokens: Energy-Based Fine-Tuning of Language Models".☆23Mar 16, 2026Updated 8 months ago
- ☆16Jan 26, 2023Updated 3 years ago
- KV Cache & LoRA for minGPT☆61Mar 4, 2026Updated 8 months ago
- Fast reinforcement learning 💨☆29Jul 15, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆12Sep 7, 2024Updated 2 years ago
- minGPT in JAX☆49Jan 10, 2022Updated 4 years ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆207Jan 19, 2026Updated 10 months ago
- JAX models for ML☆12Mar 2, 2026Updated 8 months ago
- Chessboard Computer Vision Project☆11Sep 14, 2022Updated 4 years ago
- ☆29Feb 20, 2026Updated 8 months ago
- Math tutor based on question asking☆13Jan 26, 2023Updated 3 years ago
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆67Mar 24, 2025Updated last year
- Thinker project☆16Sep 4, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Lean formalizations for the paper "ABC implies that Ramanujan's Tau function misses almost all primes"☆12Sep 11, 2026Updated 2 months ago
- Separable Physics-Informed Neural Networks for Solving the BGK Model of the Boltzmann Equation☆11Jun 13, 2025Updated last year
- Code for "Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining"☆30Oct 14, 2025Updated last year
- The goal of this application is to develop a LQR based controller to balance an inverted pendulum. This application is developed as part …☆10Mar 3, 2022Updated 4 years ago
- Design and analyze optimal deep learning models.☆32Aug 2, 2025Updated last year
- ☆10Jul 27, 2026Updated 3 months ago
- ☆267Nov 24, 2025Updated 11 months ago
Are these results useful?