Alternatives and similar repositories for pytorch_block_sparse

Users that are interested in pytorch_block_sparse are comparing it to the libraries listed below

• pytorch / nestedtensor
  [Prototype] Tools for the concurrent manipulation of variably sized Tensors.
  ☆251Updated 2 years ago
• facebookresearch / bitsandbytes
  Library for 8-bit optimizers and quantization routines.
  ☆780Updated 3 years ago
• google-research / rigl
  End-to-end training of sparse deep neural networks with little-to-no performance loss.
  ☆326Updated 2 years ago
• mlpen / Nystromformer
  ☆382Updated last year
• ptillet / torch-blocksparse
  Block-sparse primitives for PyTorch
  ☆160Updated 4 years ago
• TimDettmers / sparse_learning
  Sparse learning library and sparse momentum resources.
  ☆383Updated 3 years ago
• cybertronai / pytorch-lamb
  Implementation of https://arxiv.org/abs/1904.00962
  ☆376Updated 4 years ago
• szymonmaszke / torchdatasets
  PyTorch dataset extended with map, cache etc. (tensorflow.data like)
  ☆330Updated 3 years ago
• NVIDIA / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆505Updated 4 years ago
• google-research / long-range-arena
  Long Range Arena for Benchmarking Efficient Transformers
  ☆764Updated last year
• Stonesjtu / pytorch_memlab
  Profiling and inspecting memory in pytorch
  ☆1,071Updated 3 weeks ago
• harvardnlp / pytorch-struct
  Fast, general, and tested differentiable structured prediction in PyTorch
  ☆1,115Updated 3 years ago
• michaelrzhang / lookahead
  Implementation for the Lookahead Optimizer.
  ☆243Updated 3 years ago
• BlackHC / toma
  Helps you write algorithms in PyTorch that adapt to the available (CUDA) memory
  ☆438Updated last year
• szymonmaszke / torchlayers
  Shape and dimension inference (Keras-like) for PyTorch layers and neural networks
  ☆572Updated 3 years ago
• f-dangel / cockpit
  Cockpit: A Practical Debugging Tool for Training Deep Neural Networks
  ☆481Updated 3 years ago
• microsoft / fastformers
  FastFormers - highly efficient transformer models for NLU
  ☆707Updated 6 months ago
• pytorch / functorch
  functorch is JAX-like composable function transforms for PyTorch.
  ☆1,437Updated last month
• microsoft / infinibatch
  Efficient, check-pointed data loading for deep learning with massive data sets.
  ☆209Updated 2 years ago
• LiyuanLucasLiu / Transformer-Clinic
  Understanding the Difficulty of Training Transformers
  ☆330Updated 3 years ago
• facebookresearch / open_lth
  A repository in preparation for open-sourcing lottery ticket hypothesis code.
  ☆632Updated 3 years ago
• huggingface / nn_pruning
  Prune a model while finetuning or training.
  ☆405Updated 3 years ago
• Santosh-Gupta / SpeedTorch
  Library for faster pinned CPU <-> GPU transfer in Pytorch
  ☆685Updated 5 years ago
• awslabs / adatune
  Gradient based Hyperparameter Tuning library in PyTorch
  ☆290Updated 5 years ago
• lucidrains / sinkhorn-transformer
  Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention
  ☆269Updated 4 years ago
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆275Updated 3 years ago
• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆301Updated 3 months ago
• lukemelas / do-you-even-need-attention
  Is the attention layer even necessary? (https://arxiv.org/abs/2105.02723)
  ☆486Updated 4 years ago
• szymonmaszke / torchfunc
  PyTorch functions and utilities to make your life easier
  ☆194Updated 4 years ago
• lucidrains / routing-transformer
  Fully featured implementation of Routing Transformer
  ☆298Updated 3 years ago