openai / blocksparse
Efficient GPU kernels for block-sparse matrix multiplication and convolution
☆1,034Updated last year
Alternatives and similar repositories for blocksparse:
Users that are interested in blocksparse are comparing it to the libraries listed below
- A GPipe implementation in PyTorch☆822Updated 6 months ago
- ATen: A TENsor library for C++11☆690Updated 5 years ago
- A domain specific language to express machine learning workloads.☆1,758Updated last year
- TVM integration into PyTorch☆453Updated 5 years ago
- Fast Block Sparse Matrices for Pytorch☆546Updated 4 years ago
- FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/☆1,246Updated this week
- Mesh TensorFlow: Model Parallelism Made Easier☆1,600Updated last year
- PyTorch elastic training☆730Updated 2 years ago
- ☆578Updated 6 years ago
- Open single and half precision gemm implementations☆374Updated last year
- Collective communications library with various primitives for multi-machine training.☆1,255Updated 3 weeks ago
- Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"☆1,544Updated 4 years ago
- common in-memory tensor structure☆930Updated 4 months ago
- The Tensor Algebra SuperOptimizer for Deep Learning☆695Updated 2 years ago
- Tutorial for building a custom CUDA function for Pytorch☆513Updated 6 years ago
- A library of GPU kernels for sparse matrix operations.☆252Updated 4 years ago
- A GPU performance profiling tool for PyTorch models☆500Updated 3 years ago
- The Tensor Algebra Compiler (taco) computes sparse tensor expressions on CPUs and GPUs☆1,272Updated 9 months ago
- PyTorch layer-by-layer model profiler☆606Updated 3 years ago
- Block-sparse primitives for PyTorch☆154Updated 3 years ago
- Running BERT without Padding☆468Updated 2 years ago
- Low-precision matrix multiplication☆1,790Updated last year
- Benchmarking Deep Learning operations on different hardware☆1,079Updated 3 years ago
- ☆374Updated 7 years ago
- [ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing☆332Updated 6 months ago
- A simple memory manager for CUDA designed to help Deep Learning frameworks manage memory☆296Updated 6 years ago
- A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.☆973Updated 4 months ago
- Library for faster pinned CPU <-> GPU transfer in Pytorch☆684Updated 4 years ago
- A performant and modular runtime for TensorFlow☆759Updated this week
- ☆385Updated 2 years ago