𧱠Modula software package
β346Aug 18, 2025Updated last year
Alternatives and similar repositories for modula
Users that are interested in modula are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Don't just regulate gradients like in Muon, regulate the weights tooβ32Jul 30, 2025Updated last year
- A single-line modification to any (dualizer-based) optimizer that allows the optimizer to adapt to the scale of the gradients as they chaβ¦β19Jan 11, 2025Updated last year
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation preconditionβ¦β207May 30, 2026Updated 4 months ago
- Supporting code for the blog post on modular manifolds.β133Sep 26, 2025Updated last year
- β285Dec 2, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Efficient optimizersβ340Sep 9, 2026Updated last month
- Dion optimizer algorithmβ558Sep 30, 2026Updated 3 weeks ago
- β72Aug 28, 2026Updated 2 months ago
- A library for unit scaling in PyTorchβ136Jul 11, 2025Updated last year
- Code for the paper "Function-Space Learning Rates"β23Jun 3, 2025Updated last year
- An implementation of PSGD Kron second-order optimizer for PyTorchβ119Jul 24, 2025Updated last year
- Minimal (truly) muP implementation, consistent with TP4 and TP5 papers notationβ14Jan 2, 2026Updated 9 months ago
- Combining SOAP and MUONβ24Feb 11, 2025Updated last year
- Maximal Update Parametrization (ΞΌP) with Flax & Optax.β16Dec 27, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean β’ AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The simplest, fastest repository for training/finetuning medium-sized GPTs.β206Jan 19, 2026Updated 9 months ago
- β38Oct 4, 2026Updated 3 weeks ago
- Compositional Linear Algebraβ519Aug 1, 2025Updated last year
- Experiment of using Tangent to autodiff tritonβ81Jan 22, 2024Updated 2 years ago
- Schedule-Free Optimization in PyTorchβ2,330Jul 28, 2026Updated 3 months ago
- β307Jul 15, 2024Updated 2 years ago
- CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 secondsβ394Nov 15, 2025Updated 11 months ago
- LoRA-Ensemble: Efficient Uncertainty Modelling for Self-attention Networksβ58Mar 7, 2026Updated 7 months ago
- Muon is an optimizer for hidden layers in neural networksβ2,912May 24, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer β’ AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- β32Aug 18, 2026Updated 2 months ago
- NanoGPT (124M) in 90 secondsβ5,976Sep 28, 2026Updated last month
- Tile primitives for speedy kernelsβ3,785Sep 12, 2026Updated last month
- Flash-Muon: An Efficient Implementation of Muon Optimizerβ264Jun 15, 2025Updated last year
- maximal update parametrization (Β΅P)β1,756Jul 17, 2024Updated 2 years ago
- WIPβ97Aug 13, 2024Updated 2 years ago
- Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adamβ89Jul 28, 2024Updated 2 years ago
- Implementation of PSGD optimizer in JAXβ41Dec 31, 2024Updated last year
- 100M tokens. Infinite compute. Lowest val loss wins.β575Oct 21, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient β’ AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- β34Oct 4, 2024Updated 2 years ago
- β63Oct 3, 2024Updated 2 years ago
- supporting pytorch FSDP for optimizersβ85Dec 8, 2024Updated last year
- β23Jun 12, 2025Updated last year
- Understand and test language model architectures on synthetic tasks.β290Mar 22, 2026Updated 7 months ago
- [Poster; ICLR 2026] [Oral; Neurips OPT2024] ΞΌLO: Compute-Efficient Meta-Generalization of Learned Optimizersβ16Apr 15, 2026Updated 6 months ago
- Named Tensors for Legible Deep Learning in JAXβ231Sep 1, 2026Updated last month