spcl / sten
Sparsity support for PyTorch
☆34Updated last month
Alternatives and similar repositories for sten:
Users that are interested in sten are comparing it to the libraries listed below
- Experiment of using Tangent to autodiff triton☆78Updated last year
- ☆36Updated 4 months ago
- extensible collectives library in triton☆85Updated last month
- ☆38Updated last year
- Distributed K-FAC preconditioner for PyTorch☆85Updated this week
- Memory Optimizations for Deep Learning (ICML 2023)☆64Updated last year
- ☆104Updated 8 months ago
- ☆81Updated last year
- ☆27Updated 3 months ago
- A bunch of kernels that might make stuff slower 😉☆40Updated this week
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆35Updated 2 weeks ago
- ☆16Updated 7 months ago
- Test suite for probing the numerical behavior of NVIDIA tensor cores☆38Updated 9 months ago
- ☆18Updated 5 years ago
- ☆22Updated last year
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆122Updated this week
- ☆42Updated 2 years ago
- Fast Hadamard transform in CUDA, with a PyTorch interface☆183Updated 11 months ago
- (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.☆38Updated 2 years ago
- A parallel framework for training deep neural networks☆58Updated last month
- Fast and memory-efficient exact attention☆68Updated 2 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆45Updated 9 months ago
- ☆78Updated 6 months ago
- ☆204Updated 2 years ago
- PyTorch bindings for CUTLASS grouped GEMM.☆88Updated last week
- Boosting 4-bit inference kernels with 2:4 Sparsity☆73Updated 8 months ago
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆102Updated this week
- ☆36Updated 8 months ago
- ☆27Updated last year
- FlexAttention w/ FlashAttention3 Support☆26Updated 7 months ago