spcl / sten
Sparsity support for PyTorch
☆34Updated 3 weeks ago
Alternatives and similar repositories for sten:
Users that are interested in sten are comparing it to the libraries listed below
- Memory Optimizations for Deep Learning (ICML 2023)☆62Updated 11 months ago
- extensible collectives library in triton☆83Updated 5 months ago
- Fast Hadamard transform in CUDA, with a PyTorch interface☆150Updated 9 months ago
- ☆35Updated 2 months ago
- Experiment of using Tangent to autodiff triton☆76Updated last year
- ☆38Updated last year
- Distributed K-FAC Preconditioner for PyTorch☆85Updated this week
- ☆26Updated last month
- ☆71Updated 3 months ago
- ☆100Updated 6 months ago
- Fast and memory-efficient exact attention☆65Updated this week
- ☆17Updated 5 years ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆99Updated this week
- TileFusion is a highly efficient kernel template library designed to elevate the level of abstraction in CUDA C for processing tiles.☆61Updated this week
- (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.☆38Updated 2 years ago
- ☆15Updated 5 months ago
- Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning☆23Updated 2 months ago
- ☆23Updated 3 months ago
- Collection of kernels written in Triton language☆108Updated 2 weeks ago
- ☆23Updated 3 months ago
- Research and development for optimizing transformers☆125Updated 4 years ago
- Estimate MFU for DeepSeekV3☆18Updated 2 months ago
- PyTorch bindings for CUTLASS grouped GEMM.☆65Updated 4 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆43Updated 7 months ago
- Code for the paper: https://arxiv.org/pdf/2309.06979.pdf☆19Updated 7 months ago
- Cavs: An Efficient Runtime System for Dynamic Neural Networks☆14Updated 4 years ago
- FlashRNN - Fast RNN Kernels with I/O Awareness☆75Updated 2 months ago
- ☆12Updated 3 years ago
- ☆22Updated last year
- Personal solutions to the Triton Puzzles☆18Updated 7 months ago