google-deepmind / nanodoLinks
β270Updated 11 months ago
Alternatives and similar repositories for nanodo
Users that are interested in nanodo are comparing it to the libraries listed below
Sorting:
- seqax = sequence modeling + JAXβ159Updated last week
- π§± Modula software packageβ200Updated 2 months ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jaxβ595Updated this week
- β122Updated last month
- The simplest, fastest repository for training/finetuning medium-sized GPTs.β134Updated this week
- Implementation of Diffusion Transformer (DiT) in JAXβ278Updated last year
- Named Tensors for Legible Deep Learning in JAXβ180Updated last month
- A MAD laboratory to improve AI architecture designs π§ͺβ120Updated 6 months ago
- Puzzles for exploring transformersβ349Updated 2 years ago
- β435Updated 8 months ago
- LoRA for arbitrary JAX models and functionsβ138Updated last year
- β78Updated 11 months ago
- CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 secondsβ251Updated 3 months ago
- Efficient optimizersβ212Updated this week
- For optimization algorithm research and development.β521Updated this week
- JAX Synergistic Memory Inspectorβ174Updated 11 months ago
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUsβ397Updated last week
- β228Updated 4 months ago
- A simple library for scaling up JAX programsβ139Updated 7 months ago
- Accelerated First Order Parallel Associative Scanβ182Updated 10 months ago
- β189Updated this week
- supporting pytorch FSDP for optimizersβ82Updated 6 months ago
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation preconditionβ¦β176Updated last week
- Understand and test language model architectures on synthetic tasks.β217Updated last week
- jax-triton contains integrations between JAX and OpenAI Tritonβ400Updated 2 weeks ago
- JAX implementation of the Llama 2 modelβ218Updated last year
- Annotated version of the Mamba paperβ485Updated last year
- Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)β94Updated 6 months ago
- β188Updated 6 months ago
- Run PyTorch in JAX. π€β252Updated 4 months ago