openai / blocksparseLinks
Efficient GPU kernels for block-sparse matrix multiplication and convolution
☆1,040Updated last year
Alternatives and similar repositories for blocksparse
Users that are interested in blocksparse are comparing it to the libraries listed below
Sorting:
- ATen: A TENsor library for C++11☆694Updated 5 years ago
- FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/☆1,342Updated this week
- A domain specific language to express machine learning workloads.☆1,759Updated 2 years ago
- Collective communications library with various primitives for multi-machine training.☆1,306Updated this week
- Fast Block Sparse Matrices for Pytorch☆545Updated 4 years ago
- A GPU performance profiling tool for PyTorch models☆503Updated 3 years ago
- A GPipe implementation in PyTorch☆842Updated 10 months ago
- C++ extensions in PyTorch☆1,092Updated 4 months ago
- Tutorial for building a custom CUDA function for Pytorch☆515Updated 6 years ago
- common in-memory tensor structure☆1,002Updated 2 weeks ago
- PyTorch elastic training☆729Updated 2 years ago
- The Tensor Algebra SuperOptimizer for Deep Learning☆714Updated 2 years ago
- Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"☆1,572Updated 4 years ago
- Block-sparse primitives for PyTorch☆155Updated 4 years ago
- ☆585Updated 7 years ago
- Make huge neural nets fit in memory☆2,794Updated 5 years ago
- TVM integration into PyTorch☆452Updated 5 years ago
- Mesh TensorFlow: Model Parallelism Made Easier☆1,607Updated last year
- Open single and half precision gemm implementations☆381Updated 2 years ago
- Implements an efficient softmax approximation as described in the paper "Efficient softmax approximation for GPUs" (http://arxiv.org/abs/…☆395Updated 6 years ago
- A library of GPU kernels for sparse matrix operations.☆264Updated 4 years ago
- Dive into Deep Learning Compiler☆645Updated 2 years ago
- Reference implementations of MLPerf™ training benchmarks☆1,673Updated 2 weeks ago
- Library for faster pinned CPU <-> GPU transfer in Pytorch☆685Updated 5 years ago
- ☆1,657Updated 6 years ago
- Benchmarking Deep Learning operations on different hardware☆1,087Updated 4 years ago
- PyTorch C++ API Documentation☆228Updated last week
- Low-precision matrix multiplication☆1,803Updated last year
- Running BERT without Padding☆471Updated 3 years ago
- PyTorch implementation of the Quasi-Recurrent Neural Network - up to 16 times faster than NVIDIA's cuDNN LSTM☆1,261Updated 3 years ago