Don't just regulate gradients like in Muon, regulate the weights too
☆32Jul 30, 2025Updated last year
Alternatives and similar repositories for lipschitz-transformers
Users that are interested in lipschitz-transformers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tools for visualizing neural nets☆22Jul 29, 2025Updated last year
- ☆36Aug 14, 2026Updated last month
- 🧱 Modula software package☆342Aug 18, 2025Updated last year
- Code for the paper "Function-Space Learning Rates"☆23Jun 3, 2025Updated last year
- [NeurIPS'25] Towards Interpretability Without Sacrifice: Faithful Dense Layer Decomposition with Mixture of Decoders☆16May 28, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆16Dec 11, 2025Updated 9 months ago
- Official implementation of 'A Large-Scale Exploration of mu-Transfer' (CoRR 2024)☆32Jun 5, 2025Updated last year
- Maximal Update Parametrization (μP) with Flax & Optax.☆16Dec 27, 2023Updated 2 years ago
- Supporting code for the blog post on modular manifolds.☆130Sep 26, 2025Updated 11 months ago
- A fully trainable state space model (SSM)☆16Mar 18, 2025Updated last year
- Code for experiments on transformers using Markovian data.☆22Nov 22, 2024Updated last year
- Code to generate figures of paper "When do spectral gradient updates help in deep learning?"☆17Dec 3, 2025Updated 9 months ago
- ☆70Aug 28, 2026Updated 3 weeks ago
- ☆24Dec 11, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A single-line modification to any (dualizer-based) optimizer that allows the optimizer to adapt to the scale of the gradients as they cha…☆19Jan 11, 2025Updated last year
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆262Jun 15, 2025Updated last year
- ☆25Dec 16, 2025Updated 9 months ago
- Auto math prover.☆10Jul 10, 2024Updated 2 years ago
- Code for Spectral Norm of Convolutional Layers with Circular and Zero Paddings and Efficient Bound of Lipschitz Constant for Convolutiona…☆16Feb 2, 2024Updated 2 years ago
- Expanding linear RNN state-transition matrix eigenvalues to include negatives improves state-tracking tasks and language modeling without…☆22Mar 15, 2025Updated last year
- This is the official implementation for paper "On Powerful Ways to Generate: Autoregression, Diffusion, and Beyond".☆23Nov 17, 2025Updated 10 months ago
- nanoGPT using Equinox☆15Mar 3, 2023Updated 3 years ago
- SKT A.X LLM 3.1☆13Jul 24, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆13Jul 2, 2024Updated 2 years ago
- Multi-Layer Sparse Autoencoders (ICLR 2025)☆30Feb 6, 2026Updated 7 months ago
- Jax like function transformation engine but micro, microjax☆34Oct 25, 2024Updated last year
- ☆27Dec 3, 2023Updated 2 years ago
- ☆34Oct 4, 2024Updated last year
- GeoZarr extension for OpenLayers☆12Jun 27, 2024Updated 2 years ago
- JAX Scalify: end-to-end scaled arithmetics☆18Oct 30, 2024Updated last year
- Schedule free optimiser implemented in JAX using Optimistix☆14May 29, 2024Updated 2 years ago
- Gemstones: A Model Suite for Multi-Faceted Scaling Laws (NeurIPS 2025)☆35Sep 28, 2025Updated 11 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [NeurIPS 2025] Official code for "Tropical Attention: Neural Algorithmic Reasoning for Combinatorial Algorithms"☆33May 21, 2026Updated 4 months ago
- [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning☆154Feb 25, 2026Updated 6 months ago
- ☆45Nov 1, 2025Updated 10 months ago
- Code for "Kuramoto Orientation Diffusion"☆35Nov 7, 2025Updated 10 months ago
- 4-bit Shampoo for Memory-Efficient Network Training (NeurIPS 2024)☆13Feb 13, 2025Updated last year
- Experiments on the impact of depth in transformers and SSMs.☆47Oct 23, 2025Updated 10 months ago
- Single-pass Adaptive Image Tokenization for Minimum Program Search | What's the Kolmogorov Complexity of an Image?☆45Jul 26, 2025Updated last year