Minimal but scalable implementation of large language models in JAX
☆35Nov 28, 2025Updated 3 months ago
Alternatives and similar repositories for mintext
Users that are interested in mintext are comparing it to the libraries listed below
Sorting:
- TPU pod commander is a package for managing and launching jobs on Google Cloud TPU pods.☆21Sep 24, 2025Updated 5 months ago
- Distributed pretraining of large language models (LLMs) on cloud TPU slices, with Jax and Equinox.☆25Sep 29, 2024Updated last year
- Minimal yet performant LLM examples in pure JAX☆245Jan 14, 2026Updated 2 months ago
- Einsum-like high-level array sharding API for JAX☆34Jul 16, 2024Updated last year
- ☆10Jun 27, 2024Updated last year
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆19Jul 24, 2025Updated 7 months ago
- A simple library for scaling up JAX programs☆146Nov 4, 2025Updated 4 months ago
- VC-FB and MC-FB algorithms from "Zero-Shot Reinforcement Learning from Low Quality Data" (NeurIPS 2024)☆27Jan 14, 2025Updated last year
- Maximal Update Parametrization (μP) with Flax & Optax.☆16Dec 27, 2023Updated 2 years ago
- JAX Synergistic Memory Inspector☆185Jul 16, 2024Updated last year
- A JAX implementation of stochastic addition.☆14Aug 15, 2022Updated 3 years ago
- Data-Driven NetHack Tools: Datasets (30+) and recurrent-baselines (AWAC, BC, CQL, IQL, REM)☆43Aug 22, 2023Updated 2 years ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆32Jun 5, 2025Updated 9 months ago
- Mitigating Partial Observability in Sequential Decision Processes via the Lambda Discrepancy☆23Oct 28, 2024Updated last year
- Frechet inception distance (FID) evaluation in JAX☆14May 28, 2024Updated last year
- Jax/Flax rewrite of Karpathy's nanoGPT☆64Feb 15, 2023Updated 3 years ago
- A flexible and efficient implementation of Flash Attention 2.0 for JAX, supporting multiple backends (GPU/TPU/CPU) and platforms (Triton/…☆34Mar 4, 2025Updated last year
- Turn jitted jax functions back into python source code☆23Dec 16, 2024Updated last year
- A comprehensive JAX/NNX library for diffusion and flow matching generative algorithms, featuring DiT (Diffusion Transformer) and its vari…☆140Oct 16, 2025Updated 5 months ago
- Train very large language models in Jax.☆210Oct 21, 2023Updated 2 years ago
- seqax = sequence modeling + JAX☆187Jul 23, 2025Updated 8 months ago
- Modern, minimal, and modular LaTeX CV template ✨ 📄☆28Dec 4, 2025Updated 3 months ago
- Official Implementation for "In-Context Reinforcement Learning from Noise Distillation"☆34Sep 18, 2024Updated last year
- Two implementations of ZeRO-1 optimizer sharding in JAX☆14Jun 11, 2023Updated 2 years ago
- GULAG: GUessing LAnGuages with neural networks☆13May 4, 2022Updated 3 years ago
- ☆306Jul 15, 2024Updated last year
- Object-Centric-Representation Library (OCRL): This repo is to explore OCR on various downstream tasks from supervised learning tasks to R…☆12Feb 23, 2024Updated 2 years ago
- Machine Learning eXperiment Utilities☆48Jul 29, 2025Updated 7 months ago
- Measuring the Signal to Noise Ratio in Language Model Evaluation☆29Aug 19, 2025Updated 7 months ago
- JAX implementation of VQVAE/VQGAN autoencoders (+FSQ)☆42Jun 6, 2024Updated last year
- An implementation of the Llama architecture, to instruct and delight☆21May 31, 2025Updated 9 months ago
- Accelerate, Optimize performance with streamlined training and serving options with JAX.☆342Updated this week
- A set of Python scripts that makes your experience on TPU better☆56Sep 18, 2025Updated 6 months ago
- Official implementation for "Q-Ensemble for Offline RL: Don't Scale the Ensemble, Scale the Batch Size", NeurIPS 2022, Offline RL Worksho…☆21Feb 27, 2023Updated 3 years ago
- Code for "Evidence of Learned Look-Ahead in a Chess-Playing Neural Network"☆27Jun 4, 2024Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆699Jan 26, 2026Updated last month
- ☆16Jul 16, 2024Updated last year
- Fork of Triton repository for OpenXLA uses of the Triton language and compiler☆15Feb 24, 2026Updated 3 weeks ago
- Fast, simple, cryptographically strong random numbers in C++. Experimental.☆19Dec 12, 2013Updated 12 years ago