Alternatives and similar repositories for torch-blocksparse

Users that are interested in torch-blocksparse are comparing it to the libraries listed below

• spcl / substation
  Research and development for optimizing transformers
  ☆131Updated 4 years ago
• HazyResearch / butterfly
  Butterfly matrix multiplication in PyTorch
  ☆177Updated 2 years ago
• parasj / checkmate
  Training neural networks in TensorFlow 2.0 with 5x less memory
  ☆137Updated 3 years ago
• YulhwaKim / cutlass_tilesparse
  CUDA templates for tile-sparse matrix multiplication based on CUTLASS.
  ☆50Updated 7 years ago
• google-research / sputnik
  A library of GPU kernels for sparse matrix operations.
  ☆277Updated 5 years ago
• HazyResearch / fly
  ☆221Updated 2 years ago
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆277Updated 3 years ago
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆57Updated 3 years ago
• Tiiiger / QPyTorch
  Low Precision Arithmetic Simulation in PyTorch
  ☆287Updated last year
• albanD / subclass_zoo
  ☆185Updated last year
• huggingface / pytorch_block_sparse
  Fast Block Sparse Matrices for Pytorch
  ☆550Updated 4 years ago
• TezRomacH / layer-to-layer-pytorch
  PyTorch implementation of L2L execution algorithm
  ☆109Updated 2 years ago
• NVIDIA / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆509Updated 4 years ago
• google-research / rigl
  End-to-end training of sparse deep neural networks with little-to-no performance loss.
  ☆331Updated 2 years ago
• pytorch / nestedtensor
  [Prototype] Tools for the concurrent manipulation of variably sized Tensors.
  ☆250Updated 3 years ago
• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆67Updated 2 years ago
• utsaslab / MONeT
  MONeT framework for reducing memory consumption of DNN training
  ☆174Updated 4 years ago
• mit-han-lab / hardware-aware-transformers
  [ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing
  ☆336Updated last year
• mlcommons / training_results_v0.7
  This repository contains the results and code for the MLPerf™ Training v0.7 benchmark.
  ☆57Updated 2 years ago
• stanford-futuredata / stk
  ☆113Updated last year
• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆301Updated 5 months ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆159Updated 2 years ago
• pytorch / tensorpipe
  A tensor-aware point-to-point communication primitive for machine learning
  ☆275Updated last month
• pytorch / rfcs
  PyTorch RFCs (experimental)
  ☆136Updated 6 months ago
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆117Updated last year
• harvardnlp / genbmm
  CUDA kernels for generalized matrix-multiplication in PyTorch
  ☆85Updated 4 years ago
• google / aqt
  ☆337Updated 2 weeks ago
• cli99 / flops-profiler
  pytorch-profiler
  ☆51Updated 2 years ago
• meta-pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆161Updated 2 months ago
• graphcore / poptorch
  PyTorch interface for the IPU
  ☆181Updated 2 years ago