HMUNACHI / nanodl
A Jax-based library for designing and training transformer models from scratch.
☆280Updated 5 months ago
Alternatives and similar repositories for nanodl:
Users that are interested in nanodl are comparing it to the libraries listed below
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆536Updated this week
- ☆203Updated 6 months ago
- Named Tensors for Legible Deep Learning in JAX☆161Updated this week
- For optimization algorithm research and development.☆486Updated last week
- Orbax provides common checkpointing and persistence utilities for JAX users☆328Updated this week
- ☆114Updated this week
- ☆111Updated 3 weeks ago
- Library for reading and processing ML training data.☆371Updated this week
- ☆244Updated 3 months ago
- Neural Networks for JAX☆83Updated 4 months ago
- Train very large language models in Jax.☆198Updated last year
- JAX Synergistic Memory Inspector☆165Updated 6 months ago
- LoRA for arbitrary JAX models and functions☆135Updated 11 months ago
- ☆181Updated this week
- jax-triton contains integrations between JAX and OpenAI Triton☆371Updated last week
- CLU lets you write beautiful training loops in JAX.☆329Updated this week
- JAX implementation of the Llama 2 model☆213Updated 11 months ago
- JAX-Toolbox☆279Updated this week
- 🧱 Modula software package☆134Updated this week
- Implementation of Diffusion Transformer (DiT) in JAX☆261Updated 7 months ago
- A stand-alone implementation of several NumPy dtype extensions used in machine learning.☆240Updated this week
- Unofficial JAX implementations of deep learning research papers☆153Updated 2 years ago
- Automatic gradient descent☆206Updated last year
- ☆413Updated 3 months ago
- A simple library for scaling up JAX programs☆129Updated 2 months ago
- ☆296Updated 7 months ago
- Compositional Linear Algebra☆456Updated this week
- Annotated version of the Mamba paper☆470Updated 11 months ago
- Puzzles for exploring transformers☆331Updated last year
- Run PyTorch in JAX. 🤝☆216Updated 3 weeks ago