spcl / sten
Sparsity support for PyTorch
☆34Updated 3 weeks ago
Alternatives and similar repositories for sten:
Users that are interested in sten are comparing it to the libraries listed below
- extensible collectives library in triton☆84Updated 2 weeks ago
- ☆38Updated last year
- Experiment of using Tangent to autodiff triton☆78Updated last year
- Distributed K-FAC Preconditioner for PyTorch☆85Updated this week
- Memory Optimizations for Deep Learning (ICML 2023)☆62Updated last year
- ☆36Updated 4 months ago
- ☆76Updated 5 months ago
- ☆103Updated 7 months ago
- ☆27Updated 3 months ago
- Fast Hadamard transform in CUDA, with a PyTorch interface☆168Updated 10 months ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆110Updated this week
- Fast and memory-efficient exact attention☆67Updated last month
- Triton-based implementation of Sparse Mixture of Experts.☆211Updated 4 months ago
- PyTorch bindings for CUTLASS grouped GEMM.☆81Updated 5 months ago
- (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.☆38Updated 2 years ago
- Collection of kernels written in Triton language☆118Updated last week
- ☆40Updated 8 months ago
- ☆24Updated 5 months ago
- ☆10Updated 3 years ago
- CUDA templates for tile-sparse matrix multiplication based on CUTLASS.☆51Updated 7 years ago
- Cavs: An Efficient Runtime System for Dynamic Neural Networks☆14Updated 4 years ago
- ☆81Updated last year
- ☆14Updated 2 years ago
- Sirius, an efficient correction mechanism, which significantly boosts Contextual Sparsity models on reasoning tasks while maintaining its…☆21Updated 7 months ago
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆80Updated last week
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆45Updated 9 months ago
- A parallel framework for training deep neural networks☆58Updated last month
- Boosting 4-bit inference kernels with 2:4 Sparsity☆72Updated 7 months ago
- ☆42Updated 2 years ago
- SparseTIR: Sparse Tensor Compiler for Deep Learning☆134Updated 2 years ago