openai / blocksparse
Efficient GPU kernels for block-sparse matrix multiplication and convolution
☆1,039Updated last year
Alternatives and similar repositories for blocksparse:
Users that are interested in blocksparse are comparing it to the libraries listed below
- FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/☆1,313Updated this week
- Fast Block Sparse Matrices for Pytorch☆545Updated 4 years ago
- ATen: A TENsor library for C++11☆694Updated 5 years ago
- A domain specific language to express machine learning workloads.☆1,759Updated 2 years ago
- Tutorial for building a custom CUDA function for Pytorch☆511Updated 6 years ago
- Open single and half precision gemm implementations☆381Updated 2 years ago
- The Tensor Algebra SuperOptimizer for Deep Learning☆710Updated 2 years ago
- Quantized Neural Network PACKage - mobile-optimized implementation of quantized neural network operators☆1,540Updated 5 years ago
- Collective communications library with various primitives for multi-machine training.☆1,294Updated this week
- Low-precision matrix multiplication☆1,800Updated last year
- A GPipe implementation in PyTorch☆837Updated 9 months ago
- TVM integration into PyTorch☆452Updated 5 years ago
- Mesh TensorFlow: Model Parallelism Made Easier☆1,605Updated last year
- Implements an efficient softmax approximation as described in the paper "Efficient softmax approximation for GPUs" (http://arxiv.org/abs/…☆394Updated 6 years ago
- Block-sparse primitives for PyTorch☆155Updated 4 years ago
- Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"☆1,569Updated 4 years ago
- A GPU performance profiling tool for PyTorch models☆505Updated 3 years ago
- C++ extensions in PyTorch☆1,083Updated 3 months ago
- nGraph has moved to OpenVINO☆1,349Updated 4 years ago
- PyTorch elastic training☆730Updated 2 years ago
- Make huge neural nets fit in memory☆2,786Updated 5 years ago
- The Tensor Algebra Compiler (taco) computes sparse tensor expressions on CPUs and GPUs☆1,293Updated 3 weeks ago
- Reference implementations of MLPerf™ training benchmarks☆1,664Updated 3 weeks ago
- common in-memory tensor structure☆983Updated 3 weeks ago
- A Python-level JIT compiler designed to make unmodified PyTorch programs faster.☆1,040Updated last year
- Benchmarking Deep Learning operations on different hardware☆1,083Updated 4 years ago
- Dive into Deep Learning Compiler☆646Updated 2 years ago
- A pedagogical implementation of Autograd☆978Updated 4 years ago
- A performant and modular runtime for TensorFlow☆761Updated 2 weeks ago
- Compiler for Neural Network hardware accelerators☆3,289Updated 11 months ago