Implementing scalable LLMs in pure JAX (no third-party libraries)
☆56Jun 11, 2026Updated 3 months ago
Alternatives and similar repositories for nanoGPTJAX
Users that are interested in nanoGPTJAX are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official Repository of Paper "Watch the Weights: Unsupervised monitoring and control of fine-tuned LLMs"☆15Sep 25, 2025Updated last year
- ☆15Sep 29, 2022Updated 4 years ago
- Xtructure is datastructure for using in JAX☆23Sep 25, 2026Updated 2 weeks ago
- A dataloader, but for JAX☆20May 17, 2024Updated 2 years ago
- ☆31Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size☆19May 19, 2019Updated 7 years ago
- ☆28Feb 20, 2026Updated 7 months ago
- C++-Animation-(Standard-Template-Library)-Engine,or CASTLE for short,is a C++ plotting and animation engine created by BiliBili uploader …☆11Jan 17, 2021Updated 5 years ago
- 6,080-param transformer achieving 100% accuracy on 10-digit addition. Trained from scratch in 10 minutes.☆22Feb 19, 2026Updated 7 months ago
- Code for "Matching Features, Not Tokens: Energy-Based Fine-Tuning of Language Models".☆23Mar 16, 2026Updated 6 months ago
- Fork of Flame repo for training of some new stuff in development☆20Aug 27, 2026Updated last month
- ☆18Nov 10, 2023Updated 2 years ago
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Mar 24, 2025Updated last year
- minGPT in JAX☆49Jan 10, 2022Updated 4 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- KV Cache & LoRA for minGPT☆61Mar 4, 2026Updated 7 months ago
- Fast reinforcement learning 💨☆29Jul 15, 2025Updated last year
- The goal of this application is to develop a LQR based controller to balance an inverted pendulum. This application is developed as part …☆10Mar 3, 2022Updated 4 years ago
- Code for "Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining"☆30Oct 14, 2025Updated 11 months ago
- Course on Flash-attention in Triton☆104Feb 9, 2026Updated 8 months ago
- Jax implementation of x-LSTM: Extended Long Short-Term Memory by Beck et al. (2024)☆16Aug 6, 2024Updated 2 years ago
- Supporting code for the blog post on modular manifolds.☆130Sep 26, 2025Updated last year
- ☆263Nov 24, 2025Updated 10 months ago
- Code for the paper "Stable Gradients for Stable Learning at Scale in Deep Reinforcement Learning". Great performance in many environments…☆39Oct 24, 2025Updated 11 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Official Code for What Makes and Breaks Safety Fine-tuning? A Mechanistic Study (NeurIPS 2024)☆11Oct 31, 2024Updated last year
- Minimal open-source implementation of AlphaProof and HyperTree Proof Search.☆93May 13, 2026Updated 4 months ago
- https://github.com/gpu-mode/reference-kernels☆27Jul 4, 2026Updated 3 months ago
- A set of Python scripts that makes your experience on TPU better☆56Sep 18, 2025Updated last year
- ☆29May 11, 2026Updated 4 months ago
- Notebooks for IPAM Tutorial, March 15 2019☆24Mar 15, 2019Updated 7 years ago
- SIMPLE Algorithm for Driven Cavity problem on collocated grid using C++.☆20Feb 17, 2021Updated 5 years ago
- BPE modification that implements removing of the intermediate tokens during tokenizer training.☆27Nov 25, 2024Updated last year
- Global CoT Analysis: Initial attempts to uncover patterns across many chains of thought☆20Feb 10, 2026Updated 7 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- fast combinations calculation in jax☆40Jul 12, 2024Updated 2 years ago
- Official implementation of "Reasoning by Superposition: A Theoretical Perspective on Chain of Continuous Thought" (NeurIPS 2025)☆45Oct 8, 2025Updated last year
- ☆36Nov 30, 2025Updated 10 months ago
- This repo is built to facilitate the training and analysis of autoregressive transformers on maze-solving tasks.☆35Oct 28, 2025Updated 11 months ago
- Applications leveraged by Statistics Canada, ready to launch on Kubernetes using Helm.☆10Dec 8, 2025Updated 10 months ago
- Flax (Jax) implementation of DeepSeek-R1-Distill-Qwen-1.5B with weights ported from Hugging Face.☆26Feb 20, 2025Updated last year
- Numerical Optimisation Library☆17Jul 9, 2023Updated 3 years ago