ptillet / torch-blocksparse

Related projects ⓘ

Alternatives and complementary repositories for torch-blocksparse

• HazyResearch / butterfly
  Butterfly matrix multiplication in PyTorch
  ☆164Updated last year
• Tiiiger / QPyTorch
  Low Precision Arithmetic Simulation in PyTorch
  ☆264Updated 5 months ago
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆248Updated 2 years ago
• TezRomacH / layer-to-layer-pytorch
  PyTorch implementation of L2L execution algorithm
  ☆106Updated last year
• spcl / substation
  Research and development for optimizing transformers
  ☆124Updated 3 years ago
• YulhwaKim / cutlass_tilesparse
  CUDA templates for tile-sparse matrix multiplication based on CUTLASS.
  ☆49Updated 6 years ago
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆53Updated 2 years ago
• HazyResearch / fly
  ☆192Updated last year
• parasj / checkmate
  Training neural networks in TensorFlow 2.0 with 5x less memory
  ☆128Updated 2 years ago
• huggingface / pytorch_block_sparse
  Fast Block Sparse Matrices for Pytorch
  ☆545Updated 3 years ago
• mit-han-lab / hardware-aware-transformers
  [ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing
  ☆328Updated 3 months ago
• albanD / subclass_zoo
  ☆147Updated 4 months ago
• google-research / sputnik
  A library of GPU kernels for sparse matrix operations.
  ☆246Updated 3 years ago
• utsaslab / MONeT
  MONeT framework for reducing memory consumption of DNN training
  ☆173Updated 3 years ago
• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆67Updated last year
• NVlabs / condensa
  Programmable Neural Network Compression
  ☆146Updated 2 years ago
• stevenygd / SWALP
  Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".
  ☆62Updated 5 years ago
• google-research / rigl
  End-to-end training of sparse deep neural networks with little-to-no performance loss.
  ☆317Updated last year
• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆296Updated 3 years ago
• ischlag / fast-weight-transformers
  Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.
  ☆99Updated 3 years ago
• pytorch / nestedtensor
  [Prototype] Tools for the concurrent manipulation of variably sized Tensors.
  ☆253Updated last year
• harvardnlp / genbmm
  CUDA kernels for generalized matrix-multiplication in PyTorch
  ☆79Updated 3 years ago
• cli99 / flops-profiler
  pytorch-profiler
  ☆49Updated last year
• gpauloski / kfac-pytorch
  Distributed K-FAC Preconditioner for PyTorch
  ☆80Updated this week
• uber-research / deconstructing-lottery-tickets
  ☆143Updated last year
• hongyi-zhang / Fixup
  A Re-implementation of Fixed-update Initialization
  ☆151Updated 5 years ago
• uwsampl / dtr-prototype
  Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616
  ☆129Updated last year
• mit-han-lab / neurips-micronet
  [JMLR'20] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion
  ☆40Updated 3 years ago
• facebookresearch / FBTT-Embedding
  This is a Tensor Train based compression library to compress sparse embedding tables used in large-scale machine learning models such as …
  ☆192Updated 2 years ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆59Updated 7 months ago