Alternatives and similar repositories for pytorch_block_sparse

Users that are interested in pytorch_block_sparse are comparing it to the libraries listed below

• facebookresearch / bitsandbytes
  Library for 8-bit optimizers and quantization routines.
  ☆716Updated 2 years ago
• pytorch / nestedtensor
  [Prototype] Tools for the concurrent manipulation of variably sized Tensors.
  ☆251Updated 2 years ago
• prigoyal / pytorch_memonger
  Experimental ground for optimizing memory of pytorch models
  ☆366Updated 7 years ago
• google-research / long-range-arena
  Long Range Arena for Benchmarking Efficient Transformers
  ☆759Updated last year
• Stonesjtu / pytorch_memlab
  Profiling and inspecting memory in pytorch
  ☆1,061Updated 11 months ago
• cybertronai / pytorch-lamb
  Implementation of https://arxiv.org/abs/1904.00962
  ☆377Updated 4 years ago
• mlpen / Nystromformer
  ☆376Updated last year
• google-research / rigl
  End-to-end training of sparse deep neural networks with little-to-no performance loss.
  ☆324Updated 2 years ago
• harvardnlp / pytorch-struct
  Fast, general, and tested differentiable structured prediction in PyTorch
  ☆1,114Updated 3 years ago
• michaelrzhang / lookahead
  Implementation for the Lookahead Optimizer.
  ☆241Updated 3 years ago
• ptillet / torch-blocksparse
  Block-sparse primitives for PyTorch
  ☆157Updated 4 years ago
• NVIDIA / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆503Updated 3 years ago
• pytorch / functorch
  functorch is JAX-like composable function transforms for PyTorch.
  ☆1,432Updated this week
• awslabs / adatune
  Gradient based Hyperparameter Tuning library in PyTorch
  ☆290Updated 4 years ago
• lucidrains / routing-transformer
  Fully featured implementation of Routing Transformer
  ☆296Updated 3 years ago
• szymonmaszke / torchdatasets
  PyTorch dataset extended with map, cache etc. (tensorflow.data like)
  ☆329Updated 3 years ago
• Santosh-Gupta / SpeedTorch
  Library for faster pinned CPU <-> GPU transfer in Pytorch
  ☆685Updated 5 years ago
• TimDettmers / sparse_learning
  Sparse learning library and sparse momentum resources.
  ☆381Updated 3 years ago
• microsoft / fastformers
  FastFormers - highly efficient transformer models for NLU
  ☆705Updated 3 months ago
• LiyuanLucasLiu / Transformer-Clinic
  Understanding the Difficulty of Training Transformers
  ☆329Updated 3 years ago
• awwong1 / torchprof
  PyTorch layer-by-layer model profiler
  ☆607Updated 4 years ago
• BlackHC / toma
  Helps you write algorithms in PyTorch that adapt to the available (CUDA) memory
  ☆438Updated 10 months ago
• f-dangel / cockpit
  Cockpit: A Practical Debugging Tool for Training Deep Neural Networks
  ☆480Updated 3 years ago
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆270Updated 3 years ago
• microsoft / infinibatch
  Efficient, check-pointed data loading for deep learning with massive data sets.
  ☆208Updated 2 years ago
• szymonmaszke / torchlayers
  Shape and dimension inference (Keras-like) for PyTorch layers and neural networks
  ☆571Updated 3 years ago
• Lightning-Universe / lightning-transformers
  Flexible components pairing 🤗 Transformers with Pytorch Lightning
  ☆609Updated 2 years ago
• jacobkimmel / pytorch_modelsize
  Estimates the size of a PyTorch model in memory
  ☆358Updated 5 years ago
• ray-project / ray_lightning
  Pytorch Lightning Distributed Accelerators using Ray
  ☆211Updated last year
• lucidrains / sinkhorn-transformer
  Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention
  ☆265Updated 3 years ago