Implementing scalable LLMs in pure JAX (no third-party libraries)
☆56Jun 11, 2026Updated 4 months ago
Alternatives and similar repositories for nanoGPTJAX
Users that are interested in nanoGPTJAX are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official Repository of Paper "Watch the Weights: Unsupervised monitoring and control of fine-tuned LLMs"☆15Sep 25, 2025Updated last year
- Deriving steepest descent convergence bounds and hyperparameter scaling laws in machine learning optimization from first principles, form…☆17Apr 11, 2026Updated 6 months ago
- ☆13Jan 6, 2026Updated 9 months ago
- ☆15Sep 29, 2022Updated 4 years ago
- Code for Looped Transformers for Length Generalization (https://arxiv.org/abs/2409.15647), ICLR 2025☆14Apr 30, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Reproducing GPT on the TinyStories dataset☆22Jan 18, 2024Updated 2 years ago
- Xtructure is datastructure for using in JAX☆23Updated this week
- Code for "What really matters in matrix-whitening optimizers?"☆25Oct 31, 2025Updated 11 months ago
- ☆42Feb 18, 2025Updated last year
- The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size☆19May 19, 2019Updated 7 years ago
- DepthBench: Measuring How Residual Connections Enable More Computational Depth☆19Oct 21, 2026Updated last week
- nanoGPT using Equinox☆15Mar 3, 2023Updated 3 years ago
- JAX models for ML☆12Mar 2, 2026Updated 7 months ago
- 6,080-param transformer achieving 100% accuracy on 10-digit addition. Trained from scratch in 10 minutes.☆22Feb 19, 2026Updated 8 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆16Jan 26, 2023Updated 3 years ago
- Code for "Matching Features, Not Tokens: Energy-Based Fine-Tuning of Language Models".☆23Mar 16, 2026Updated 7 months ago
- ☆19Mar 10, 2026Updated 7 months ago
- ☆28Feb 20, 2026Updated 8 months ago
- Visualization of mean field and neural tangent kernel regime☆23Jul 25, 2024Updated 2 years ago
- Official Github for Wharton STAT 4830☆58Apr 16, 2026Updated 6 months ago
- Fast reinforcement learning 💨☆29Jul 15, 2025Updated last year
- KV Cache & LoRA for minGPT☆61Mar 4, 2026Updated 7 months ago
- The goal of this application is to develop a LQR based controller to balance an inverted pendulum. This application is developed as part …☆10Mar 3, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆206Jan 19, 2026Updated 9 months ago
- ☆18Nov 10, 2023Updated 2 years ago
- Fork of Flame repo for training of some new stuff in development☆20Aug 27, 2026Updated 2 months ago
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆67Mar 24, 2025Updated last year
- ☆265Nov 24, 2025Updated 11 months ago
- Code for "Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining"☆30Oct 14, 2025Updated last year
- Jax implementation of x-LSTM: Extended Long Short-Term Memory by Beck et al. (2024)☆16Aug 6, 2024Updated 2 years ago
- Design and analyze optimal deep learning models.☆32Aug 2, 2025Updated last year
- ☆10Jul 27, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- some common Huggingface transformers in maximal update parametrization (µP)☆88Mar 14, 2022Updated 4 years ago
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆148May 6, 2026Updated 5 months ago
- Code for the paper "Stable Gradients for Stable Learning at Scale in Deep Reinforcement Learning". Great performance in many environments…☆39Oct 24, 2025Updated last year
- https://github.com/gpu-mode/reference-kernels☆27Jul 4, 2026Updated 3 months ago
- ☆35Jul 5, 2023Updated 3 years ago
- Official Code for What Makes and Breaks Safety Fine-tuning? A Mechanistic Study (NeurIPS 2024)☆11Oct 31, 2024Updated last year
- ☆29May 11, 2026Updated 5 months ago