huggingface / pytorch_block_sparse

Related projects ⓘ

Alternatives and complementary repositories for pytorch_block_sparse

• ptillet / torch-blocksparse
  Block-sparse primitives for PyTorch
  ☆148Updated 3 years ago
• facebookresearch / bitsandbytes
  Library for 8-bit optimizers and quantization routines.
  ☆714Updated 2 years ago
• pytorch / nestedtensor
  [Prototype] Tools for the concurrent manipulation of variably sized Tensors.
  ☆253Updated 2 years ago
• google-research / rigl
  End-to-end training of sparse deep neural networks with little-to-no performance loss.
  ☆317Updated last year
• NVIDIA / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆495Updated 3 years ago
• awwong1 / torchprof
  PyTorch layer-by-layer model profiler
  ☆608Updated 3 years ago
• LiyuanLucasLiu / Transformer-Clinic
  Understanding the Difficulty of Training Transformers
  ☆328Updated 2 years ago
• harvardnlp / pytorch-struct
  Fast, general, and tested differentiable structured prediction in PyTorch
  ☆1,108Updated 2 years ago
• mlpen / Nystromformer
  ☆365Updated last year
• michaelrzhang / lookahead
  Implementation for the Lookahead Optimizer.
  ☆239Updated 2 years ago
• huggingface / nn_pruning
  Prune a model while finetuning or training.
  ☆394Updated 2 years ago
• prigoyal / pytorch_memonger
  Experimental ground for optimizing memory of pytorch models
  ☆360Updated 6 years ago
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆249Updated 2 years ago
• Stonesjtu / pytorch_memlab
  Profiling and inspecting memory in pytorch
  ☆1,020Updated 3 months ago
• szymonmaszke / torchdatasets
  PyTorch dataset extended with map, cache etc. (tensorflow.data like)
  ☆328Updated 2 years ago
• google-research / long-range-arena
  Long Range Arena for Benchmarking Efficient Transformers
  ☆729Updated 11 months ago
• microsoft / infinibatch
  Efficient, check-pointed data loading for deep learning with massive data sets.
  ☆205Updated last year
• facebookresearch / open_lth
  A repository in preparation for open-sourcing lottery ticket hypothesis code.
  ☆627Updated 2 years ago
• cybertronai / pytorch-lamb
  Implementation of https://arxiv.org/abs/1904.00962
  ☆369Updated 3 years ago
• Santosh-Gupta / SpeedTorch
  Library for faster pinned CPU <-> GPU transfer in Pytorch
  ☆683Updated 4 years ago
• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆296Updated 3 years ago
• TimDettmers / sparse_learning
  Sparse learning library and sparse momentum resources.
  ☆379Updated 2 years ago
• microsoft / fastformers
  FastFormers - highly efficient transformer models for NLU
  ☆701Updated 10 months ago
• pytorch / functorch
  functorch is JAX-like composable function transforms for PyTorch.
  ☆1,396Updated this week
• TezRomacH / layer-to-layer-pytorch
  PyTorch implementation of L2L execution algorithm
  ☆106Updated last year
• lucidrains / sinkhorn-transformer
  Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention
  ☆253Updated 3 years ago
• Lightning-Universe / lightning-transformers
  Flexible components pairing 🤗 Transformers with Pytorch Lightning
  ☆611Updated last year
• f-dangel / cockpit
  Cockpit: A Practical Debugging Tool for Training Deep Neural Networks
  ☆473Updated 2 years ago
• lucidrains / routing-transformer
  Fully featured implementation of Routing Transformer
  ☆284Updated 3 years ago
• szymonmaszke / torchlayers
  Shape and dimension inference (Keras-like) for PyTorch layers and neural networks
  ☆569Updated 2 years ago