openai / blocksparse
Efficient GPU kernels for block-sparse matrix multiplication and convolution
☆1,027Updated last year
Related projects ⓘ
Alternatives and complementary repositories for blocksparse
- Fast Block Sparse Matrices for Pytorch☆545Updated 3 years ago
- ATen: A TENsor library for C++11☆683Updated 5 years ago
- FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/☆1,210Updated this week
- A GPU performance profiling tool for PyTorch models☆495Updated 3 years ago
- A domain specific language to express machine learning workloads.☆1,761Updated last year
- A GPipe implementation in PyTorch☆818Updated 3 months ago
- Collective communications library with various primitives for multi-machine training.☆1,227Updated this week
- Mesh TensorFlow: Model Parallelism Made Easier☆1,591Updated last year
- PyTorch elastic training☆730Updated 2 years ago
- The Tensor Algebra SuperOptimizer for Deep Learning☆692Updated last year
- common in-memory tensor structure☆912Updated last month
- Tutorial for building a custom CUDA function for Pytorch☆514Updated 5 years ago
- TVM integration into PyTorch☆452Updated 4 years ago
- Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"☆1,524Updated 4 years ago
- Block-sparse primitives for PyTorch☆148Updated 3 years ago
- Open single and half precision gemm implementations☆374Updated last year
- Library for faster pinned CPU <-> GPU transfer in Pytorch☆683Updated 4 years ago
- Make huge neural nets fit in memory☆2,730Updated 4 years ago
- ☆568Updated 6 years ago
- Experimental ground for optimizing memory of pytorch models☆360Updated 6 years ago
- A performant and modular runtime for TensorFlow☆756Updated last month
- Guide for building custom op for TensorFlow☆378Updated last year
- A tensor-aware point-to-point communication primitive for machine learning☆249Updated last year
- ☆378Updated 2 years ago
- Fast, general, and tested differentiable structured prediction in PyTorch☆1,108Updated 2 years ago
- Implements an efficient softmax approximation as described in the paper "Efficient softmax approximation for GPUs" (http://arxiv.org/abs/…☆395Updated 5 years ago
- PyTorch layer-by-layer model profiler☆608Updated 3 years ago
- A CUDNN minimal deep learning training code sample using LeNet.☆263Updated last year
- TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.☆875Updated this week
- Profiling and inspecting memory in pytorch☆1,020Updated 3 months ago