Alternatives and similar repositories for pytorch_block_sparse:

Users that are interested in pytorch_block_sparse are comparing it to the libraries listed below

• facebookresearch / bitsandbytes
  Library for 8-bit optimizers and quantization routines.
  ☆718Updated 2 years ago
• prigoyal / pytorch_memonger
  Experimental ground for optimizing memory of pytorch models
  ☆366Updated 6 years ago
• pytorch / nestedtensor
  [Prototype] Tools for the concurrent manipulation of variably sized Tensors.
  ☆253Updated 2 years ago
• ptillet / torch-blocksparse
  Block-sparse primitives for PyTorch
  ☆154Updated 3 years ago
• LiyuanLucasLiu / Transformer-Clinic
  Understanding the Difficulty of Training Transformers
  ☆328Updated 2 years ago
• lucidrains / routing-transformer
  Fully featured implementation of Routing Transformer
  ☆289Updated 3 years ago
• awwong1 / torchprof
  PyTorch layer-by-layer model profiler
  ☆606Updated 3 years ago
• google-research / long-range-arena
  Long Range Arena for Benchmarking Efficient Transformers
  ☆747Updated last year
• NVIDIA / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆505Updated 3 years ago
• lucidrains / sinkhorn-transformer
  Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention
  ☆260Updated 3 years ago
• cybertronai / pytorch-lamb
  Implementation of https://arxiv.org/abs/1904.00962
  ☆372Updated 4 years ago
• google-research / rigl
  End-to-end training of sparse deep neural networks with little-to-no performance loss.
  ☆319Updated 2 years ago
• pytorch / functorch
  functorch is JAX-like composable function transforms for PyTorch.
  ☆1,414Updated this week
• mlpen / Nystromformer
  ☆376Updated last year
• harvardnlp / pytorch-struct
  Fast, general, and tested differentiable structured prediction in PyTorch
  ☆1,112Updated 2 years ago
• Lightning-Universe / lightning-transformers
  Flexible components pairing 🤗 Transformers with Pytorch Lightning
  ☆609Updated 2 years ago
• huggingface / nn_pruning
  Prune a model while finetuning or training.
  ☆400Updated 2 years ago
• TimDettmers / sparse_learning
  Sparse learning library and sparse momentum resources.
  ☆379Updated 2 years ago
• michaelrzhang / lookahead
  Implementation for the Lookahead Optimizer.
  ☆240Updated 2 years ago
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆260Updated 2 years ago
• microsoft / fastformers
  FastFormers - highly efficient transformer models for NLU
  ☆704Updated last year
• facebookresearch / open_lth
  A repository in preparation for open-sourcing lottery ticket hypothesis code.
  ☆629Updated 2 years ago
• pytorch / elastic
  PyTorch elastic training
  ☆730Updated 2 years ago
• szymonmaszke / torchdatasets
  PyTorch dataset extended with map, cache etc. (tensorflow.data like)
  ☆328Updated 2 years ago
• openai / blocksparse
  Efficient GPU kernels for block-sparse matrix multiplication and convolution
  ☆1,039Updated last year
• microsoft / infinibatch
  Efficient, check-pointed data loading for deep learning with massive data sets.
  ☆205Updated last year
• Santosh-Gupta / SpeedTorch
  Library for faster pinned CPU <-> GPU transfer in Pytorch
  ☆685Updated 5 years ago
• jacobkimmel / pytorch_modelsize
  Estimates the size of a PyTorch model in memory
  ☆357Updated 4 years ago
• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆298Updated 3 years ago
• Stonesjtu / pytorch_memlab
  Profiling and inspecting memory in pytorch
  ☆1,049Updated 7 months ago