Alternatives and similar repositories for TorchPQ:

Users that are interested in TorchPQ are comparing it to the libraries listed below

• lucidrains / sinkhorn-transformer
  Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention
  ☆257Updated 3 years ago
• mlpen / Nystromformer
  ☆371Updated last year
• huggingface / pytorch_block_sparse
  Fast Block Sparse Matrices for Pytorch
  ☆546Updated 4 years ago
• NVIDIA / transformer-ls
  Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).
  ☆226Updated 2 years ago
• kakaobrain / torchlars
  A LARS implementation in PyTorch
  ☆341Updated 5 years ago
• DeMoriarty / fast_pytorch_kmeans
  This is a pytorch implementation of k-means clustering algorithm
  ☆297Updated 2 months ago
• lucidrains / linear-attention-transformer
  Transformer based on a variant of attention that is linear complexity in respect to sequence length
  ☆738Updated 9 months ago
• google-research / diffstride
  TF/Keras code for DiffStride, a pooling layer with learnable strides.
  ☆124Updated 3 years ago
• ctlllll / SGConv
  ☆163Updated 2 years ago
• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆298Updated 3 years ago
• lucidrains / routing-transformer
  Fully featured implementation of Routing Transformer
  ☆288Updated 3 years ago
• ptillet / torch-blocksparse
  Block-sparse primitives for PyTorch
  ☆153Updated 3 years ago
• lucidrains / slot-attention
  Implementation of Slot Attention from GoogleAI
  ☆410Updated 6 months ago
• facebookresearch / torchdim
  Named tensors with first-class dimensions for PyTorch
  ☆321Updated last year
• lucidrains / local-attention
  An implementation of local windowed attention for language modeling
  ☆420Updated last month
• subhadarship / kmeans_pytorch
  kmeans using PyTorch
  ☆502Updated last year
• lucidrains / memory-efficient-attention-pytorch
  Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"
  ☆370Updated last year
• dalmia / siren
  PyTorch implementation of Sinusodial Representation networks (SIREN)
  ☆263Updated 2 years ago
• luyug / GradCache
  Run Effective Large Batch Contrastive Learning Beyond GPU/TPU Memory Constraint
  ☆374Updated 10 months ago
• lucidrains / flash-cosine-sim-attention
  Implementation of fused cosine similarity attention in the same style as Flash Attention
  ☆210Updated 2 years ago
• zzd1992 / Image-Local-Attention
  A better PyTorch implementation of image local attention which reduces the GPU memory by an order of magnitude.
  ☆137Updated 3 years ago
• facebookresearch / FFCV-SSL
  FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.
  ☆204Updated last year
• BlackHC / toma
  Helps you write algorithms in PyTorch that adapt to the available (CUDA) memory
  ☆433Updated 5 months ago
• google-research / long-range-arena
  Long Range Arena for Benchmarking Efficient Transformers
  ☆745Updated last year
• lucidrains / linformer
  Implementation of Linformer for Pytorch
  ☆266Updated last year
• facebookresearch / mega
  Sequence modeling with Mega.
  ☆298Updated 2 years ago
• PhilJd / contiguous_pytorch_params
  Accelerate training by storing parameters in one contiguous chunk of memory.
  ☆292Updated 4 years ago
• krasserm / perceiver-io
  A PyTorch implementation of Perceiver, Perceiver IO and Perceiver AR with PyTorch Lightning scripts for distributed training
  ☆452Updated last year
• facebookresearch / diffq
  DiffQ performs differentiable quantization using pseudo quantization noise. It can automatically tune the number of bits used per weight …
  ☆235Updated last year
• prigoyal / pytorch_memonger
  Experimental ground for optimizing memory of pytorch models
  ☆364Updated 6 years ago