The Newton-Muon optimizer
☆30Jun 5, 2026Updated last month
Alternatives and similar repositories for Newton-Muon
Users that are interested in Newton-Muon are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official repository for Parallax (Parameterized Local Linear Attention)☆63Jul 7, 2026Updated last week
- Muon in Int8 Precision Made Possible☆20Jun 18, 2026Updated 3 weeks ago
- Triton kernels and PyTorch ops for Block Attention Residuals (AttnRes)☆84May 29, 2026Updated last month
- Spectral Sphere Optimizer☆130Mar 23, 2026Updated 3 months ago
- My attempt to improve the speed of the newton schulz algorithm, starting from the dion implementation.☆38Apr 30, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- All-in-one benchmarking platform for evaluating LLM.☆15Nov 12, 2025Updated 8 months ago
- Stick-breaking attention☆63Jul 1, 2025Updated last year
- mHC-lite: You Don’t Need 20 Sinkhorn-Knopp Iterations☆91Jan 12, 2026Updated 6 months ago
- Fast Polar Decomposition for Muon☆165Jul 2, 2026Updated last week
- ☆37Aug 7, 2025Updated 11 months ago
- This repositories contains the reference implementation for the Sparse Delta Memory paper.More precisely, it contains the model definitio…☆24Updated this week
- ☆24Oct 10, 2025Updated 9 months ago
- ☆52Mar 9, 2026Updated 4 months ago
- An efficient implementation of the NSA (Native Sparse Attention) kernel☆133Jun 24, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Official Project Page for HLA: Higher-order Linear Attention (https://arxiv.org/abs/2510.27258)☆102Jun 15, 2026Updated 3 weeks ago
- DeeperGEMM: crazy optimized version☆86May 5, 2025Updated last year
- Fast and memory-efficient exact attention☆22Jun 26, 2026Updated 2 weeks ago
- Based on the R1-Zero method, using rule-based rewards and GRPO on the Code Contests dataset.☆18Apr 22, 2025Updated last year
- ☆33Dec 31, 2025Updated 6 months ago
- FlexAttention w/ FlashAttention3 Support☆27Oct 5, 2024Updated last year
- Use the tokenizer in parallel to achieve superior acceleration☆20Mar 21, 2024Updated 2 years ago
- Detect wildfires using ML on images from cameras on vantage points☆11Jun 6, 2026Updated last month
- Implementation of Fast Weight Attention☆32Jun 3, 2026Updated last month
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Official PyTorch Implementation of Gated DeltaNet-2: Decoupling Erase and Write in Linear Attention☆237May 25, 2026Updated last month
- Code for paper Almost-Orthogonal Layers for Efficient General-Purpose Lipschitz Networks☆13Aug 9, 2022Updated 3 years ago
- Flash-Linear-Attention models beyond language☆21Aug 28, 2025Updated 10 months ago
- NVIDIA cuTile learn☆168Dec 9, 2025Updated 7 months ago
- Muon fsdp 2☆62Aug 8, 2025Updated 11 months ago
- High-performance GPU kernels for LLM inference in OpenAI Triton. Fused RMSNorm, SwiGLU, INT8 GEMM with benchmarks and roofline analysis.☆31Apr 5, 2026Updated 3 months ago
- Compact and Agent-Native MoE Training System☆253Updated this week
- Expert Specialization MoE Solution based on CUTLASS☆27Apr 14, 2026Updated 3 months ago
- 💻 Terminal-Agent with Human-in-the-Loop Learning☆40Jan 16, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆71Jul 8, 2025Updated last year
- Measuring the Signal to Noise Ratio in Language Model Evaluation☆31Aug 19, 2025Updated 10 months ago
- Official code for the NeurIPS25 paper "RAT: Bridging RNN Efficiencyand Attention Accuracy in Language Modeling" (https://arxiv.org/abs/25…☆26Dec 10, 2025Updated 7 months ago
- ☆17Dec 31, 2023Updated 2 years ago
- [MLSys 26] 🥇 Solution for Gated Delta Net Track of MLSys 26 Flash infer competition☆35May 22, 2026Updated last month
- JAX bindings for the flash-attention3 kernels☆23Jan 2, 2026Updated 6 months ago
- [ICML25] CODESYNC: Synchronizing Large Language Models with Dynamic Code Evolution at Scale☆25Jul 31, 2025Updated 11 months ago