openai / blocksparseLinks
Efficient GPU kernels for block-sparse matrix multiplication and convolution
☆1,062Updated 2 years ago
Alternatives and similar repositories for blocksparse
Users that are interested in blocksparse are comparing it to the libraries listed below
Sorting:
- ATen: A TENsor library for C++11☆713Updated 6 years ago
- FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/☆1,512Updated this week
- A GPipe implementation in PyTorch☆861Updated last year
- Mesh TensorFlow: Model Parallelism Made Easier☆1,624Updated 2 years ago
- Fast Block Sparse Matrices for Pytorch☆550Updated 4 years ago
- Collective communications library with various primitives for multi-machine training.☆1,386Updated this week
- A domain specific language to express machine learning workloads.☆1,762Updated 2 years ago
- Benchmarking Deep Learning operations on different hardware☆1,103Updated 4 years ago
- The Tensor Algebra SuperOptimizer for Deep Learning☆734Updated 2 years ago
- A GPU performance profiling tool for PyTorch models☆509Updated 4 years ago
- Tutorial for building a custom CUDA function for Pytorch☆521Updated 6 years ago
- C++ extensions in PyTorch☆1,177Updated 6 months ago
- Guide for building custom op for TensorFlow☆385Updated 2 years ago
- common in-memory tensor structure☆1,136Updated last month
- TVM integration into PyTorch☆456Updated 5 years ago
- Block-sparse primitives for PyTorch☆160Updated 4 years ago
- Open single and half precision gemm implementations☆395Updated 2 years ago
- TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.☆1,002Updated this week
- ☆600Updated 7 years ago
- PyTorch elastic training☆728Updated 3 years ago
- A performant and modular runtime for TensorFlow☆756Updated 4 months ago
- A CUDNN minimal deep learning training code sample using LeNet.☆268Updated 2 years ago
- A tensor-aware point-to-point communication primitive for machine learning☆282Updated 3 weeks ago
- Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"☆1,606Updated 5 years ago
- Library for faster pinned CPU <-> GPU transfer in Pytorch☆683Updated 5 years ago
- A library of GPU kernels for sparse matrix operations.☆281Updated 5 years ago
- Reference implementations of MLPerf® training benchmarks☆1,736Updated 3 weeks ago
- Low-precision matrix multiplication☆1,827Updated last year
- Make huge neural nets fit in memory☆2,826Updated 5 years ago
- Codebase for "SLIDE : In Defense of Smart Algorithms over Hardware Acceleration for Large-Scale Deep Learning Systems"☆1,106Updated 4 years ago