This repository is an open source implementation of the MuonClip strategy from the KIMI K2 Model from Moonshot AI
☆30Nov 7, 2025Updated last year
Alternatives and similar repositories for MuonClip
Users that are interested in MuonClip are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆265Jun 15, 2025Updated last year
- Efficient connectivity-preserving loss function for training neural networks to perform instance segmentation.☆13Apr 21, 2026Updated 6 months ago
- Implementation of the Pairformer model used in AlphaFold 3☆14Oct 26, 2026Updated 3 weeks ago
- Brainwave is a state-of-the-art neural decoder that transforms electroencephalogram (EEG) and brain signals into multimodal outputs inclu…☆14Oct 6, 2025Updated last year
- ☆25May 23, 2026Updated 5 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [ICML 2024] Official Repository for the paper "Transformers Get Stable: An End-to-End Signal Propagation Theory for Language Models"☆11Jul 19, 2024Updated 2 years ago
- Universal Neurons in GPT2 Language Models☆31May 28, 2024Updated 2 years ago
- Welcome to Prometheus, the revolutionary AI model that allows you to generate DNA sequences for any creature you can imagine. Whether it’…☆17Updated this week
- A simple and minimal open source implementation of "Introducing LFM2: The Fastest On-Device Foundation Models on the Market" from Liquid …☆34Oct 26, 2026Updated 3 weeks ago
- Pytorch implementation of our UniQ method, IEEE Access -- Training Multi-bit Quantized and Binarized Networks with A Learnable Symmetric …☆11Apr 7, 2021Updated 5 years ago
- An open source community implementation of the model MELLE from the paper: "Autoregressive Speech Synthesis without Vector Quantization"☆16Updated this week
- We introduce VLM-Mamba, the first Vision-Language Model built entirely on State Space Models (SSMs), specifically leveraging the Mamba ar…☆15Jan 5, 2026Updated 10 months ago
- Implementation of PyTorch: "GAMBA: MARRY GAUSSIAN SPLATTING WITH MAMBA FOR SINGLE-VIEW 3D RECONSTRUCTION"☆65Oct 6, 2025Updated last year
- Jeroen Cottaar's work for the Kaggle Geophysical Waveform Inversion competition (2nd place)☆15Aug 11, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A very hacky set of functions for getting plotly to do what I want when doing mech interp research, designed to be compatible with PyTorc…☆16Jun 16, 2023Updated 3 years ago
- Translation Mod for Dwarf Fortress☆14Aug 12, 2026Updated 3 months ago
- [ACL 2025] Outlier-Safe Pre-Training for Robust 4-Bit Quantization of Large Language Models☆40Nov 4, 2025Updated last year
- Extremely simple MoE implementation, mostly based off Switch Transformer☆13Feb 26, 2024Updated 2 years ago
- FlashAttention for sliding window attention in Triton (fwd + bwd pass)☆13Jun 25, 2025Updated last year
- An open-source AI agent that brings the power of Gemini directly into your terminal.☆10Jun 27, 2025Updated last year
- ☆10Sep 19, 2026Updated last month
- ☆12Jun 2, 2026Updated 5 months ago
- 🚁 TypeScript port of google/diff-match-patch.☆13Jan 26, 2026Updated 9 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆32Oct 26, 2026Updated 3 weeks ago
- VibEx (vx) is a developer-friendly CLI tool that streamlines the process of working with AI coding assistants. It helps developers prepar…☆29Jul 10, 2026Updated 4 months ago
- Homework of CER☆11Apr 12, 2021Updated 5 years ago
- Ongoing research training transformer models at scale☆13Nov 5, 2026Updated last week
- Weight-Space Programming Without LLMs☆50Updated this week
- ☆11Oct 17, 2024Updated 2 years ago
- Dist-MoE implements Speed-of-Light distributed Mixture-of-Experts forward and backward kernels. They are highly optimized and fused comm-…☆79Updated this week
- GC MoE is a CuTe DSL implementation of FP8/FP4 mixture-of-experts inference with CUDA Green Contexts for NVIDIA Hopper and Blackwell GPUs…☆37Updated this week
- [EMNLP 2024 Oral] Model Balancing Helps Low Data Training and Fine-tuning☆13Oct 22, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- CVPR 2021 | Code to reproduce the results of the paper: A Khakzar, S Baselizadeh, S Khanduja, C Rupprecht, ST Kim, N Navab, Neural Respon…☆12Jun 23, 2021Updated 5 years ago
- My Implementation of " Structure and Content-Guided Video Synthesis with Diffusion Models" by RunwayML☆26Jan 16, 2024Updated 2 years ago
- Implementation for POET and POET-X for LLM pretraining☆44Jun 9, 2026Updated 5 months ago
- ☆16Nov 11, 2026Updated last week
- Understand Your Agents. Turn agent logs into interactive maps and stories. Explore decisions, replay the work, and get answers linked to …☆93Updated this week
- An implementation of the paper Brain2Qwerty that translates brain EEG data into text for reading people's brains. There was no code so we…☆32Feb 9, 2025Updated last year
- Muon is Scalable for LLM Training☆1,562Aug 3, 2025Updated last year
Are these results useful?