Use Muon optimizer instead of AdamW.
☆50Mar 2, 2026Updated 6 months ago
Alternatives and similar repositories for muon-optimizer-guide
Users that are interested in muon-optimizer-guide are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Conformal Prediction + Federated Learning☆16Mar 16, 2024Updated 2 years ago
- An efficient and scalable attention module designed to reduce memory usage and improve inference speed in large language models. Designe…☆26Jun 25, 2025Updated last year
- NanoGPT (124M) as fast as possible☆21Apr 15, 2025Updated last year
- ☆21Nov 28, 2023Updated 2 years ago
- Official Code for What Makes and Breaks Safety Fine-tuning? A Mechanistic Study (NeurIPS 2024)☆11Oct 31, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Flax (JAX) implementation of Progressive Growing of GANs for Improved Quality, Stability, and Variation☆12May 24, 2021Updated 5 years ago
- A framework to meta-train transformers for causal ICL☆11Jul 15, 2026Updated 2 months ago
- 100M tokens. Infinite compute. Lowest val loss wins.☆541Sep 15, 2026Updated last week
- Implementation of Fast Weight Attention☆35Updated this week
- Code repository for "RL Grokking Recipe: How RL Unlocks and Transfers New Algorithms in LLMs""☆35Oct 12, 2025Updated 11 months ago
- Code for the paper *Attention Drift: What Speculative Decoding Models Learn*.☆28May 12, 2026Updated 4 months ago
- [Preprint] AdaVAE: Exploring Adaptive GPT-2s in VAEs for Language Modeling PyTorch Implementation☆38Oct 18, 2023Updated 2 years ago
- Official Repository of Paper "Watch the Weights: Unsupervised monitoring and control of fine-tuned LLMs"☆15Sep 25, 2025Updated 11 months ago
- ☆23Jun 2, 2026Updated 3 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆28Jun 3, 2022Updated 4 years ago
- ☆21Aug 27, 2023Updated 3 years ago
- exploring machine learning, deep learning, mathematics, statistics and data science though curated resources☆14Nov 29, 2023Updated 2 years ago
- ☆22May 12, 2026Updated 4 months ago
- Utilities for PyTorch distributed☆26Feb 27, 2025Updated last year
- ☆13May 4, 2023Updated 3 years ago
- Open-source Human Feedback Library☆11Oct 25, 2023Updated 2 years ago
- ☆20Sep 6, 2025Updated last year
- ☆16Apr 13, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Distilled version of LaGAT: a neuro-guided search for multi-agent pathfinding (MAPF)☆16Jul 18, 2026Updated 2 months ago
- An automatic differentiation system for dense and sparse problems☆13Jan 16, 2025Updated last year
- The best ChatGPT that $100 can buy.☆58Updated this week
- Matching and Weighting Multiply Imputed Datasets☆20Oct 24, 2024Updated last year
- Extend the Conditioning of Stable Diffusion to take Audio Embeddings Instead of Text Embeddings using Wav2Vec2-BERT model☆13Sep 25, 2024Updated last year
- block-stm implementation in golang that works with cosmos-sdk☆15Dec 13, 2024Updated last year
- ☆19May 20, 2026Updated 4 months ago
- Instant Neural Graphics Primitives from scratch, zero dependencies. Learning by doing.☆10Aug 18, 2023Updated 3 years ago
- ☆12Jun 17, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Option, Try, Either, and some more common basic DataTypes☆13Jul 1, 2023Updated 3 years ago
- Solidity library for implementing Rain compatible interpreters.☆16Updated this week
- Example code for the NNGeometry PyTorch library☆11Sep 10, 2026Updated last week
- Supporting code for the blog post on modular manifolds.☆130Sep 26, 2025Updated 11 months ago
- ☆12Apr 19, 2024Updated 2 years ago
- Implementation of "RaanA: A Fast, Flexible, and Data-Efficient Post-Training Quantization Algorithm"☆18Apr 11, 2025Updated last year
- fanuc mtconnect adapter☆12Jan 22, 2016Updated 10 years ago