Alternatives and similar repositories for TorchPQ

Users that are interested in TorchPQ are comparing it to the libraries listed below

• lucidrains / sinkhorn-transformer
  Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention
  ☆269Updated 4 years ago
• NVIDIA / transformer-ls
  Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).
  ☆228Updated 3 years ago
• lucidrains / routing-transformer
  Fully featured implementation of Routing Transformer
  ☆300Updated 4 years ago
• lucidrains / local-attention
  An implementation of local windowed attention for language modeling
  ☆494Updated 6 months ago
• DeMoriarty / fast_pytorch_kmeans
  This is a pytorch implementation of k-means clustering algorithm
  ☆339Updated 10 months ago
• google-research / diffstride
  TF/Keras code for DiffStride, a pooling layer with learnable strides.
  ☆124Updated 3 years ago
• lucidrains / flash-cosine-sim-attention
  Implementation of fused cosine similarity attention in the same style as Flash Attention
  ☆220Updated 2 years ago
• lucidrains / memory-efficient-attention-pytorch
  Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"
  ☆390Updated 2 years ago
• mlpen / Nystromformer
  ☆388Updated 2 years ago
• facebookresearch / mega
  Sequence modeling with Mega.
  ☆302Updated 3 years ago
• pytorch / nestedtensor
  [Prototype] Tools for the concurrent manipulation of variably sized Tensors.
  ☆250Updated 3 years ago
• lucidrains / linformer
  Implementation of Linformer for Pytorch
  ☆306Updated 2 years ago
• facebookresearch / diffq
  DiffQ performs differentiable quantization using pseudo quantization noise. It can automatically tune the number of bits used per weight …
  ☆237Updated 2 years ago
• krasserm / perceiver-io
  A PyTorch implementation of Perceiver, Perceiver IO and Perceiver AR with PyTorch Lightning scripts for distributed training
  ☆507Updated 2 years ago
• AminRezaei0x443 / memory-efficient-attention
  Memory Efficient Attention (O(sqrt(n)) for Jax and PyTorch
  ☆184Updated 3 years ago
• ctlllll / SGConv
  ☆163Updated 3 years ago
• huggingface / pytorch_block_sparse
  Fast Block Sparse Matrices for Pytorch
  ☆550Updated 5 years ago
• facebookresearch / torchdim
  Named tensors with first-class dimensions for PyTorch
  ☆332Updated 2 years ago
• ptillet / torch-blocksparse
  Block-sparse primitives for PyTorch
  ☆160Updated 4 years ago
• cybertronai / pytorch-lamb
  Implementation of https://arxiv.org/abs/1904.00962
  ☆377Updated 5 years ago
• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆300Updated 7 months ago
• lukemelas / do-you-even-need-attention
  Is the attention layer even necessary? (https://arxiv.org/abs/2105.02723)
  ☆485Updated 4 years ago
• kakaobrain / torchlars
  A LARS implementation in PyTorch
  ☆352Updated 5 years ago
• Felix-Petersen / diffsort
  Differentiable Sorting Networks
  ☆125Updated 2 years ago
• zzd1992 / Image-Local-Attention
  A better PyTorch implementation of image local attention which reduces the GPU memory by an order of magnitude.
  ☆142Updated 4 years ago
• LeviViana / torch_sampling
  Efficient reservoir sampling implementation for PyTorch
  ☆107Updated 4 years ago
• fadel / pytorch_ema
  Tiny PyTorch library for maintaining a moving average of a collection of parameters.
  ☆444Updated last year
• HomebrewML / revlib
  Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload
  ☆131Updated 3 years ago
• lucidrains / Mega-pytorch
  Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena
  ☆206Updated 2 years ago
• lucidrains / hourglass-transformer-pytorch
  Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI
  ☆98Updated 4 years ago