facebookresearch / optimizersLinks
For optimization algorithm research and development.
☆530Updated last week
Alternatives and similar repositories for optimizers
Users that are interested in optimizers are comparing it to the libraries listed below
Sorting:
- MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…☆389Updated last week
- Annotated version of the Mamba paper☆488Updated last year
- Implementation of Diffusion Transformer (DiT) in JAX☆291Updated last year
- Efficient optimizers☆254Updated 3 weeks ago
- TensorDict is a pytorch dedicated tensor container.☆955Updated last week
- ☆275Updated last year
- Scalable and Performant Data Loading☆291Updated this week
- ☆307Updated last year
- A Jax-based library for building transformers, includes implementations of GPT, Gemma, LlaMa, Mixtral, Whisper, SWin, ViT and more.☆290Updated 11 months ago
- CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds☆283Updated last month
- Universal Tensor Operations in Einstein-Inspired Notation for Python.☆399Updated 4 months ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆568Updated last week
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆646Updated this week
- Library for reading and processing ML training data.☆505Updated this week
- ☆207Updated 8 months ago
- The AdEMAMix Optimizer: Better, Faster, Older.☆184Updated 11 months ago
- 🧱 Modula software package☆225Updated last week
- Named tensors with first-class dimensions for PyTorch☆331Updated 2 years ago
- ☆444Updated 10 months ago
- Official Implementation of "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"☆428Updated 8 months ago
- Puzzles for exploring transformers☆366Updated 2 years ago
- Helpful tools and examples for working with flex-attention☆943Updated this week
- Dion optimizer algorithm☆305Updated this week
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆523Updated this week
- jax-triton contains integrations between JAX and OpenAI Triton☆414Updated 2 months ago
- Implementation of Flash Attention in Jax☆216Updated last year
- An implementation of PSGD Kron second-order optimizer for PyTorch☆96Updated last month
- Implementation of https://srush.github.io/annotated-s4☆499Updated 2 months ago
- Best practices & guides on how to write distributed pytorch training code☆470Updated 6 months ago
- Transform datasets at scale. Optimize datasets for fast AI model training.☆525Updated last week