Alternatives and similar repositories for torch-blocksparse

Users that are interested in torch-blocksparse are comparing it to the libraries listed below

• spcl / substation
  Research and development for optimizing transformers
  ☆129Updated 4 years ago
• YulhwaKim / cutlass_tilesparse
  CUDA templates for tile-sparse matrix multiplication based on CUTLASS.
  ☆51Updated 7 years ago
• HazyResearch / butterfly
  Butterfly matrix multiplication in PyTorch
  ☆169Updated last year
• HazyResearch / fly
  ☆208Updated 2 years ago
• huggingface / pytorch_block_sparse
  Fast Block Sparse Matrices for Pytorch
  ☆547Updated 4 years ago
• TezRomacH / layer-to-layer-pytorch
  PyTorch implementation of L2L execution algorithm
  ☆107Updated 2 years ago
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆268Updated 3 years ago
• parasj / checkmate
  Training neural networks in TensorFlow 2.0 with 5x less memory
  ☆131Updated 3 years ago
• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆299Updated 2 weeks ago
• google-research / sputnik
  A library of GPU kernels for sparse matrix operations.
  ☆265Updated 4 years ago
• albanD / subclass_zoo
  ☆167Updated last year
• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆67Updated last year
• Tiiiger / QPyTorch
  Low Precision Arithmetic Simulation in PyTorch
  ☆279Updated last year
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆56Updated 3 years ago
• harvardnlp / genbmm
  CUDA kernels for generalized matrix-multiplication in PyTorch
  ☆84Updated 3 years ago
• adityaiitb / pyprof2
  PyProf2: PyTorch Profiling tool
  ☆82Updated 5 years ago
• NVIDIA / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆503Updated 3 years ago
• stanford-futuredata / stk
  ☆105Updated 9 months ago
• utsaslab / MONeT
  MONeT framework for reducing memory consumption of DNN training
  ☆173Updated 4 years ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆157Updated last year
• uwsampl / dtr-prototype
  Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616
  ☆132Updated last year
• mit-han-lab / hardware-aware-transformers
  [ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing
  ☆335Updated 11 months ago
• google-research / rigl
  End-to-end training of sparse deep neural networks with little-to-no performance loss.
  ☆323Updated 2 years ago
• lucidrains / flash-cosine-sim-attention
  Implementation of fused cosine similarity attention in the same style as Flash Attention
  ☆214Updated 2 years ago
• davda54 / ada-hessian
  Easy-to-use AdaHessian optimizer (PyTorch)
  ☆79Updated 4 years ago
• epfml / dynamic-sparse-flash-attention
  ☆147Updated 2 years ago
• pytorch / nestedtensor
  [Prototype] Tools for the concurrent manipulation of variably sized Tensors.
  ☆251Updated 2 years ago
• pytorch / rfcs
  PyTorch RFCs (experimental)
  ☆132Updated 3 weeks ago
• toshas / torch-discounted-cumsum
  Fast Discounted Cumulative Sums in PyTorch
  ☆96Updated 3 years ago
• stevenygd / SWALP
  Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".
  ☆62Updated 6 years ago