nil0x9 / flash-muonLinks
Flash-Muon: An Efficient Implementation of Muon Optimizer
☆131Updated last week
Alternatives and similar repositories for flash-muon
Users that are interested in flash-muon are comparing it to the libraries listed below
Sorting:
- ☆114Updated 3 weeks ago
- The evaluation framework for training-free sparse attention in LLMs☆69Updated this week
- 🔥 A minimal training framework for scaling FLA models☆170Updated last week
- Efficient triton implementation of Native Sparse Attention.☆168Updated last month
- ☆208Updated 2 weeks ago
- ☆130Updated 4 months ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆136Updated this week
- Accelerate LLM preference tuning via prefix sharing with a single line of code☆41Updated last month
- Odysseus: Playground of LLM Sequence Parallelism☆70Updated last year
- Fast and memory-efficient exact attention☆68Updated 3 months ago
- ☆63Updated this week
- XAttention: Block Sparse Attention with Antidiagonal Scoring☆166Updated this week
- PyTorch bindings for CUTLASS grouped GEMM.☆99Updated 3 weeks ago
- ☆21Updated 3 months ago
- 🎬 3.7× faster video generation E2E 🖼️ 1.6× faster image generation E2E ⚡ ColumnSparseAttn 9.3× vs FlashAttn‑3 💨 ColumnSparseGEMM 2.5× …☆74Updated last week
- ☆109Updated last year
- ring-attention experiments☆144Updated 8 months ago
- ☆76Updated 3 months ago
- Triton-based implementation of Sparse Mixture of Experts.☆219Updated 6 months ago
- The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.☆70Updated last week
- DPO, but faster 🚀☆43Updated 6 months ago
- RWKV-7: Surpassing GPT☆91Updated 7 months ago
- Boosting 4-bit inference kernels with 2:4 Sparsity☆79Updated 9 months ago
- ☆36Updated 2 months ago
- ☆49Updated last month
- ☆105Updated 9 months ago
- Here we will test various linear attention designs.☆59Updated last year
- ☆21Updated last month
- ☆56Updated 3 months ago
- Load compute kernels from the Hub☆191Updated this week