thib-s / flash-newton-schulzLinks
My attempt to improve the speed of the newton schulz algorithm, starting from the dion implementation.
☆25Updated last month
Alternatives and similar repositories for flash-newton-schulz
Users that are interested in flash-newton-schulz are comparing it to the libraries listed below
Sorting:
- Quantized Attention on GPU☆44Updated last year
- Accelerate LLM preference tuning via prefix sharing with a single line of code☆51Updated 6 months ago
- Fast and memory-efficient exact kmeans☆131Updated last month
- ☆133Updated 7 months ago
- Odysseus: Playground of LLM Sequence Parallelism☆79Updated last year
- ☆52Updated 7 months ago
- flex-block-attn: an efficient block sparse attention computation library☆102Updated last week
- ☆116Updated 7 months ago
- ☆213Updated last month
- ☆125Updated 4 months ago
- ☆102Updated 10 months ago
- Vortex: A Flexible and Efficient Sparse Attention Framework☆43Updated last month
- An efficient implementation of the NSA (Native Sparse Attention) kernel☆128Updated 6 months ago
- An auxiliary project analysis of the characteristics of KV in DiT Attention.☆32Updated last year
- Xmixers: A collection of SOTA efficient token/channel mixers☆28Updated 4 months ago
- Transformers components but in Triton☆34Updated 7 months ago
- [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts☆40Updated last year
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆225Updated 6 months ago
- The evaluation framework for training-free sparse attention in LLMs☆108Updated 2 months ago
- [ICML 2025] SparseLoRA: Accelerating LLM Fine-Tuning with Contextual Sparsity☆64Updated 6 months ago
- ☆47Updated 3 weeks ago
- A curated list of recent papers on efficient video attention for video diffusion models, including sparsification, quantization, and cach…☆52Updated 2 months ago
- Distributed MoE in a Single Kernel [NeurIPS '25]☆174Updated this week
- A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters☆53Updated last year
- Patch convolution to avoid large GPU memory usage of Conv2D☆93Updated 11 months ago
- ☆23Updated 8 months ago
- APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…☆28Updated this week
- This repository contains code for the MicroAdam paper.☆21Updated last year
- ☆27Updated 9 months ago
- FastCache: Fast Caching for Diffusion Transformer Through Learnable Linear Approximation [Efficient ML Model]☆45Updated 3 weeks ago