Alternatives and similar repositories for TorchPQ:

Users that are interested in TorchPQ are comparing it to the libraries listed below

• lucidrains / sinkhorn-transformer
  Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention
  ☆262Updated 3 years ago
• NVIDIA / transformer-ls
  Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).
  ☆225Updated 3 years ago
• mlpen / Nystromformer
  ☆376Updated last year
• DeMoriarty / fast_pytorch_kmeans
  This is a pytorch implementation of k-means clustering algorithm
  ☆309Updated 2 months ago
• lucidrains / routing-transformer
  Fully featured implementation of Routing Transformer
  ☆291Updated 3 years ago
• lucidrains / linformer
  Implementation of Linformer for Pytorch
  ☆282Updated last year
• kakaobrain / torchlars
  A LARS implementation in PyTorch
  ☆345Updated 5 years ago
• pytorch / nestedtensor
  [Prototype] Tools for the concurrent manipulation of variably sized Tensors.
  ☆251Updated 2 years ago
• lucidrains / local-attention
  An implementation of local windowed attention for language modeling
  ☆445Updated 3 months ago
• lukemelas / do-you-even-need-attention
  Is the attention layer even necessary? (https://arxiv.org/abs/2105.02723)
  ☆484Updated 3 years ago
• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆298Updated 3 years ago
• lucidrains / flash-cosine-sim-attention
  Implementation of fused cosine similarity attention in the same style as Flash Attention
  ☆213Updated 2 years ago
• subhadarship / kmeans_pytorch
  kmeans using PyTorch
  ☆513Updated last year
• huggingface / pytorch_block_sparse
  Fast Block Sparse Matrices for Pytorch
  ☆545Updated 4 years ago
• facebookresearch / mega
  Sequence modeling with Mega.
  ☆294Updated 2 years ago
• luyug / GradCache
  Run Effective Large Batch Contrastive Learning Beyond GPU/TPU Memory Constraint
  ☆386Updated last year
• TezRomacH / layer-to-layer-pytorch
  PyTorch implementation of L2L execution algorithm
  ☆107Updated 2 years ago
• lucidrains / memory-efficient-attention-pytorch
  Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"
  ☆377Updated last year
• google-research / diffstride
  TF/Keras code for DiffStride, a pooling layer with learnable strides.
  ☆124Updated 3 years ago
• frgfm / torch-scan
  Seamless analysis of your PyTorch models (RAM usage, FLOPs, MACs, receptive field, etc.)
  ☆218Updated last month
• LeviViana / torch_sampling
  Efficient reservoir sampling implementation for PyTorch
  ☆106Updated 3 years ago
• lucidrains / long-short-transformer
  Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch
  ☆118Updated 3 years ago
• prigoyal / pytorch_memonger
  Experimental ground for optimizing memory of pytorch models
  ☆365Updated 7 years ago
• ctlllll / SGConv
  ☆164Updated 2 years ago
• AminRezaei0x443 / memory-efficient-attention
  Memory Efficient Attention (O(sqrt(n)) for Jax and PyTorch
  ☆184Updated 2 years ago
• facebookresearch / torchdim
  Named tensors with first-class dimensions for PyTorch
  ☆320Updated last year
• ppwwyyxx / RAM-multiprocess-dataloader
  Demystify RAM Usage in Multi-Process Data Loaders
  ☆193Updated 2 years ago
• lucidrains / linear-attention-transformer
  Transformer based on a variant of attention that is linear complexity in respect to sequence length
  ☆763Updated last year
• lucidrains / slot-attention
  Implementation of Slot Attention from GoogleAI
  ☆425Updated 8 months ago
• LiyuanLucasLiu / Transformer-Clinic
  Understanding the Difficulty of Training Transformers
  ☆329Updated 2 years ago