Alternatives and similar repositories for torch-blocksparse:

Users that are interested in torch-blocksparse are comparing it to the libraries listed below

• HazyResearch / fly
  ☆200Updated last year
• HazyResearch / butterfly
  Butterfly matrix multiplication in PyTorch
  ☆165Updated last year
• spcl / substation
  Research and development for optimizing transformers
  ☆125Updated 3 years ago
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆253Updated 2 years ago
• Tiiiger / QPyTorch
  Low Precision Arithmetic Simulation in PyTorch
  ☆271Updated 8 months ago
• YulhwaKim / cutlass_tilesparse
  CUDA templates for tile-sparse matrix multiplication based on CUTLASS.
  ☆49Updated 6 years ago
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆53Updated 2 years ago
• google-research / sputnik
  A library of GPU kernels for sparse matrix operations.
  ☆252Updated 4 years ago
• huggingface / pytorch_block_sparse
  Fast Block Sparse Matrices for Pytorch
  ☆546Updated 4 years ago
• harvardnlp / genbmm
  CUDA kernels for generalized matrix-multiplication in PyTorch
  ☆79Updated 3 years ago
• TezRomacH / layer-to-layer-pytorch
  PyTorch implementation of L2L execution algorithm
  ☆107Updated 2 years ago
• parasj / checkmate
  Training neural networks in TensorFlow 2.0 with 5x less memory
  ☆130Updated 2 years ago
• albanD / subclass_zoo
  ☆158Updated 7 months ago
• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆298Updated 3 years ago
• epfml / dynamic-sparse-flash-attention
  ☆136Updated last year
• stevenygd / SWALP
  Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".
  ☆62Updated 5 years ago
• NVIDIA / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆500Updated 3 years ago
• stanford-futuredata / stk
  ☆97Updated 5 months ago
• gpauloski / kfac-pytorch
  Distributed K-FAC Preconditioner for PyTorch
  ☆85Updated this week
• asappresearch / flop
  Pytorch library for factorized L0-based pruning.
  ☆45Updated last year
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆157Updated last year
• mit-han-lab / hardware-aware-transformers
  [ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing
  ☆332Updated 6 months ago
• epfml / powersgd
  Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727
  ☆145Updated 3 months ago
• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆66Updated last year
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆62Updated 10 months ago
• cli99 / flops-profiler
  pytorch-profiler
  ☆50Updated last year
• adityaiitb / pyprof2
  PyProf2: PyTorch Profiling tool
  ☆82Updated 4 years ago
• huggingface / block_movement_pruning
  Block Sparse movement pruning
  ☆78Updated 4 years ago
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆135Updated 8 months ago
• davda54 / ada-hessian
  Easy-to-use AdaHessian optimizer (PyTorch)
  ☆77Updated 4 years ago