Alternatives and similar repositories for TorchPQ:

Users that are interested in TorchPQ are comparing it to the libraries listed below

• lucidrains / sinkhorn-transformer
  Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention
  ☆260Updated 3 years ago
• lucidrains / linformer
  Implementation of Linformer for Pytorch
  ☆274Updated last year
• pytorch / nestedtensor
  [Prototype] Tools for the concurrent manipulation of variably sized Tensors.
  ☆253Updated 2 years ago
• NVIDIA / transformer-ls
  Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).
  ☆225Updated 2 years ago
• lukemelas / do-you-even-need-attention
  Is the attention layer even necessary? (https://arxiv.org/abs/2105.02723)
  ☆484Updated 3 years ago
• luyug / GradCache
  Run Effective Large Batch Contrastive Learning Beyond GPU/TPU Memory Constraint
  ☆381Updated last year
• DeMoriarty / fast_pytorch_kmeans
  This is a pytorch implementation of k-means clustering algorithm
  ☆302Updated 3 weeks ago
• google-research / diffstride
  TF/Keras code for DiffStride, a pooling layer with learnable strides.
  ☆125Updated 3 years ago
• lucidrains / routing-transformer
  Fully featured implementation of Routing Transformer
  ☆291Updated 3 years ago
• facebookresearch / mega
  Sequence modeling with Mega.
  ☆295Updated 2 years ago
• huggingface / pytorch_block_sparse
  Fast Block Sparse Matrices for Pytorch
  ☆546Updated 4 years ago
• lucidrains / local-attention
  An implementation of local windowed attention for language modeling
  ☆429Updated 2 months ago
• mlpen / Nystromformer
  ☆376Updated last year
• uclnlp / torch-imle
  Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions
  ☆257Updated last year
• michaelsdr / momentumnet
  Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities
  ☆209Updated 11 months ago
• facebookresearch / torchdim
  Named tensors with first-class dimensions for PyTorch
  ☆321Updated last year
• LiyuanLucasLiu / Transformer-Clinic
  Understanding the Difficulty of Training Transformers
  ☆328Updated 2 years ago
• ppwwyyxx / RAM-multiprocess-dataloader
  Demystify RAM Usage in Multi-Process Data Loaders
  ☆189Updated last year
• ptillet / torch-blocksparse
  Block-sparse primitives for PyTorch
  ☆154Updated 3 years ago
• deep-spin / entmax
  The entmax mapping and its loss, a family of sparse softmax alternatives.
  ☆428Updated 9 months ago
• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆298Updated 3 years ago
• Felix-Petersen / diffsort
  Differentiable Sorting Networks
  ☆114Updated last year
• lucidrains / linear-attention-transformer
  Transformer based on a variant of attention that is linear complexity in respect to sequence length
  ☆751Updated 10 months ago
• facebookresearch / bitsandbytes
  Library for 8-bit optimizers and quantization routines.
  ☆717Updated 2 years ago
• lucidrains / flash-cosine-sim-attention
  Implementation of fused cosine similarity attention in the same style as Flash Attention
  ☆212Updated 2 years ago
• microsoft / infinibatch
  Efficient, check-pointed data loading for deep learning with massive data sets.
  ☆205Updated last year
• PhilJd / contiguous_pytorch_params
  Accelerate training by storing parameters in one contiguous chunk of memory.
  ☆292Updated 4 years ago
• Felix-Petersen / difftopk
  Differentiable Top-k Classification Learning
  ☆80Updated 2 years ago
• kakaobrain / torchlars
  A LARS implementation in PyTorch
  ☆343Updated 5 years ago
• teddykoker / torchsort
  Fast, differentiable sorting and ranking in PyTorch
  ☆799Updated last year