ptillet / torch-blocksparse
Block-sparse primitives for PyTorch
☆154Updated 4 years ago
Alternatives and similar repositories for torch-blocksparse:
Users that are interested in torch-blocksparse are comparing it to the libraries listed below
- Research and development for optimizing transformers☆125Updated 4 years ago
- Butterfly matrix multiplication in PyTorch☆169Updated last year
- CUDA templates for tile-sparse matrix multiplication based on CUTLASS.☆51Updated 7 years ago
- Low Precision Arithmetic Simulation in PyTorch☆275Updated 11 months ago
- ☆202Updated 2 years ago
- Training neural networks in TensorFlow 2.0 with 5x less memory☆130Updated 3 years ago
- A library of GPU kernels for sparse matrix operations.☆262Updated 4 years ago
- Implementation of a Transformer, but completely in Triton☆263Updated 3 years ago
- PyTorch implementation of L2L execution algorithm☆107Updated 2 years ago
- ☆163Updated 10 months ago
- Customized matrix multiplication kernels☆54Updated 3 years ago
- Fast Block Sparse Matrices for Pytorch☆545Updated 4 years ago
- Structured matrices for compressing neural networks☆66Updated last year
- CUDA kernels for generalized matrix-multiplication in PyTorch☆79Updated 3 years ago
- [Prototype] Tools for the concurrent manipulation of variably sized Tensors.☆251Updated 2 years ago
- ☆103Updated 7 months ago
- Fast Discounted Cumulative Sums in PyTorch☆95Updated 3 years ago
- ☆157Updated last year
- ☆143Updated last year
- Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".☆62Updated 5 years ago
- Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616☆132Updated last year
- Easy-to-use AdaHessian optimizer (PyTorch)☆78Updated 4 years ago
- pytorch-profiler☆51Updated last year
- Distributed K-FAC Preconditioner for PyTorch☆85Updated last week
- ☆42Updated 2 years ago
- [ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing☆331Updated 9 months ago
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆156Updated 4 months ago
- ☆295Updated last week
- Block Sparse movement pruning☆79Updated 4 years ago
- PyProf2: PyTorch Profiling tool☆82Updated 4 years ago