ptillet / torch-blocksparse
Block-sparse primitives for PyTorch
☆155Updated 4 years ago
Alternatives and similar repositories for torch-blocksparse
Users that are interested in torch-blocksparse are comparing it to the libraries listed below
Sorting:
- Research and development for optimizing transformers☆126Updated 4 years ago
- Implementation of a Transformer, but completely in Triton☆265Updated 3 years ago
- CUDA templates for tile-sparse matrix multiplication based on CUTLASS.☆51Updated 7 years ago
- Low Precision Arithmetic Simulation in PyTorch☆277Updated 11 months ago
- ☆205Updated 2 years ago
- Customized matrix multiplication kernels☆54Updated 3 years ago
- A library of GPU kernels for sparse matrix operations.☆264Updated 4 years ago
- Fast Block Sparse Matrices for Pytorch☆545Updated 4 years ago
- Butterfly matrix multiplication in PyTorch☆170Updated last year
- ☆166Updated 10 months ago
- Structured matrices for compressing neural networks☆66Updated last year
- Training neural networks in TensorFlow 2.0 with 5x less memory☆131Updated 3 years ago
- CUDA kernels for generalized matrix-multiplication in PyTorch☆79Updated 3 years ago
- PyTorch implementation of L2L execution algorithm☆107Updated 2 years ago
- [ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing☆334Updated 10 months ago
- Slicing a PyTorch Tensor Into Parallel Shards☆298Updated 3 years ago
- ☆158Updated last year
- Torch Distributed Experimental☆115Updated 9 months ago
- Fast Discounted Cumulative Sums in PyTorch☆95Updated 3 years ago
- Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".☆62Updated 6 years ago
- ☆146Updated last year
- ☆104Updated 8 months ago
- ☆144Updated 2 years ago
- A research library for pytorch-based neural network pruning, compression, and more.☆161Updated 2 years ago
- PyProf2: PyTorch Profiling tool☆82Updated 4 years ago
- A library for unit scaling in PyTorch☆125Updated 5 months ago
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆157Updated 5 months ago
- [ICLR 2020] Drawing Early-Bird Tickets: Toward More Efficient Training of Deep Networks☆138Updated 4 years ago
- ☆40Updated 3 years ago
- This repository contains integer operators on GPUs for PyTorch.☆204Updated last year