π§± Modula software package
β347Aug 18, 2025Updated last year
Alternatives and similar repositories for modula
Users that are interested in modula are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Don't just regulate gradients like in Muon, regulate the weights tooβ32Jul 30, 2025Updated last year
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation preconditionβ¦β208May 30, 2026Updated 5 months ago
- A single-line modification to any (dualizer-based) optimizer that allows the optimizer to adapt to the scale of the gradients as they chaβ¦β19Jan 11, 2025Updated last year
- Supporting code for the blog post on modular manifolds.β133Sep 26, 2025Updated last year
- β290Dec 2, 2024Updated last year
- Proton VPN Special Offer - Get 70% off β’ AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Efficient optimizersβ340Sep 9, 2026Updated 2 months ago
- A library for unit scaling in PyTorchβ137Jul 11, 2025Updated last year
- β72Aug 28, 2026Updated 2 months ago
- Dion optimizer algorithmβ561Sep 30, 2026Updated last month
- Fast, Numerically Stable, and Auto-Differentiable Spectral Clipping via Newton-Schulz Iterationβ12Jun 21, 2025Updated last year
- An implementation of PSGD Kron second-order optimizer for PyTorchβ119Jul 24, 2025Updated last year
- Combining SOAP and MUONβ24Feb 11, 2025Updated last year
- Code for the paper "Function-Space Learning Rates"β23Jun 3, 2025Updated last year
- Maximal Update Parametrization (ΞΌP) with Flax & Optax.β16Dec 27, 2023Updated 2 years ago
- Virtual machines for every use case on DigitalOcean β’ AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Minimal (truly) muP implementation, consistent with TP4 and TP5 papers notationβ14Jan 2, 2026Updated 10 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.β207Jan 19, 2026Updated 9 months ago
- Experiment of using Tangent to autodiff tritonβ81Jan 22, 2024Updated 2 years ago
- Schedule-Free Optimization in PyTorchβ2,337Jul 28, 2026Updated 3 months ago
- β37Oct 4, 2026Updated last month
- Compositional Linear Algebraβ520Aug 1, 2025Updated last year
- Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adamβ89Jul 28, 2024Updated 2 years ago
- CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 secondsβ396Nov 15, 2025Updated last year
- β34Aug 18, 2026Updated 2 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits β’ AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- LoRA-Ensemble: Efficient Uncertainty Modelling for Self-attention Networksβ58Mar 7, 2026Updated 8 months ago
- β309Jul 15, 2024Updated 2 years ago
- Muon is an optimizer for hidden layers in neural networksβ2,944May 24, 2026Updated 5 months ago
- Tile primitives for speedy kernelsβ3,804Sep 12, 2026Updated 2 months ago
- NanoGPT (124M) in 90 secondsβ6,046Sep 28, 2026Updated last month
- Flash-Muon: An Efficient Implementation of Muon Optimizerβ265Jun 15, 2025Updated last year
- maximal update parametrization (Β΅P)β1,756Jul 17, 2024Updated 2 years ago
- WIPβ97Aug 13, 2024Updated 2 years ago
- Implementation of PSGD optimizer in JAXβ41Dec 31, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits β’ AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- β34Oct 4, 2024Updated 2 years ago
- Code to generate figures of paper "When do spectral gradient updates help in deep learning?"β19Dec 3, 2025Updated 11 months ago
- β63Oct 3, 2024Updated 2 years ago
- β18Aug 24, 2024Updated 2 years ago
- 100M tokens. Infinite compute. Lowest val loss wins.β582Updated this week
- supporting pytorch FSDP for optimizersβ85Dec 8, 2024Updated last year
- [Poster; ICLR 2026] [Oral; Neurips OPT2024] ΞΌLO: Compute-Efficient Meta-Generalization of Learned Optimizersβ16Apr 15, 2026Updated 7 months ago
Are these results useful?