KellerJordan / cifar10-airbenchLinks
CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds
☆327Updated 2 weeks ago
Alternatives and similar repositories for cifar10-airbench
Users that are interested in cifar10-airbench are comparing it to the libraries listed below
Sorting:
- Efficient optimizers☆276Updated 3 weeks ago
- The AdEMAMix Optimizer: Better, Faster, Older.☆186Updated last year
- 🧱 Modula software package☆307Updated 3 months ago
- supporting pytorch FSDP for optimizers☆84Updated 11 months ago
- ☆285Updated last year
- ☆224Updated last year
- Dion optimizer algorithm☆388Updated 2 weeks ago
- For optimization algorithm research and development.☆547Updated 2 weeks ago
- Accelerated First Order Parallel Associative Scan☆192Updated last year
- Implementation of Diffusion Transformer (DiT) in JAX☆296Updated last year
- A library for unit scaling in PyTorch☆132Updated 4 months ago
- Annotated version of the Mamba paper☆491Updated last year
- Getting crystal-like representations with harmonic loss☆192Updated 8 months ago
- MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…☆401Updated this week
- Normalized Transformer (nGPT)☆194Updated last year
- Universal Notation for Tensor Operations in Python.☆449Updated 7 months ago
- WIP☆93Updated last year
- Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI☆293Updated 5 months ago
- FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores☆334Updated 11 months ago
- ☆119Updated 5 months ago
- Code and weights for the paper "Cluster and Predict Latents Patches for Improved Masked Image Modeling"☆124Updated 7 months ago
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆188Updated last month
- ☆91Updated last year
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆174Updated 5 months ago
- Supporting code for the blog post on modular manifolds.☆103Updated 2 months ago
- ☆303Updated 7 months ago
- DeMo: Decoupled Momentum Optimization☆197Updated last year
- Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).☆127Updated last year
- ☆314Updated last year
- seqax = sequence modeling + JAX☆168Updated 4 months ago