Alternatives and similar repositories for softtopk:

Users that are interested in softtopk are comparing it to the libraries listed below

• fla-org / flash-bidirectional-linear-attention
  Triton implement of bi-directional (non-causal) linear attention
  ☆35Updated last week
• alihassanijr / TorchKMeans
  A torch-based implementation of K-Means and K-Means++
  ☆17Updated 4 years ago
• BBuf / flash-rwkv
  ☆31Updated 7 months ago
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated last year
• JerryYin777 / Cross-Layer-Attention
  Self Reproduction Code of Paper "Reducing Transformer Key-Value Cache Size with Cross-Layer Attention (MIT CSAIL)
  ☆12Updated 7 months ago
• FateScript / dotfiles
  useful dotfiles included vim, zsh, tmux and vscode
  ☆18Updated 3 weeks ago
• HubHop / vit-attention-benchmark
  Benchmarking Attention Mechanism in Vision Transformers.
  ☆17Updated 2 years ago
• bojone / FSQ
  Keras implement of Finite Scalar Quantization
  ☆68Updated last year
• HKUNLP / efficient-attention
  [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
  ☆80Updated last year
• bojone / tiger
  A Tight-fisted Optimizer
  ☆47Updated last year
• megvii-research / basedet
  An object detection codebase based on MegEngine.
  ☆28Updated 2 years ago
• GeeeekExplorer / cupytorch
  A small framework mimics PyTorch using CuPy or NumPy
  ☆27Updated 2 years ago
• hikvision-research / Unified-Normalization
  # Unified Normalization (ACM MM'22) By Qiming Yang, Kai Zhang, Chaoxiang Lan, Zhi Yang, Zheyang Li, Wenming Tan, Jun Xiao, and Shiliang P…
  ☆34Updated last year
• savadikarc / gift
  GIFT: Generative Interpretable Fine-Tuning
  ☆19Updated 3 months ago
• donglixp / ICL_PaperList
  Paper List for In-context Learning 🌷
  ☆20Updated 2 years ago
• HDETR / H-PETR-Pose
  [CVPR2023] This is an official implementation of paper "DETRs with Hybrid Matching".
  ☆14Updated 2 years ago
• Xianchao-Wu / perceiver-pytorch
  ☆42Updated 3 years ago
• NVlabs / COAT
  ☆52Updated last week
• ziplab / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆22Updated 10 months ago
• philippe-eecs / small-vision
  A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.
  ☆34Updated 6 months ago
• ziplab / SN-Netv2
  [ECCV 2024] This is the official implementation of "Stitched ViTs are Flexible Vision Backbones".
  ☆24Updated 11 months ago
• csarron / PuMer
  [ACL 2023] PuMer: Pruning and Merging Tokens for Efficient Vision Language Models
  ☆28Updated 3 months ago
• Optimization-AI / fast_clip
  ☆21Updated 3 months ago
• kyegomez / Blockwise-Parallel-Transformer
  32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.
  ☆44Updated last year
• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆28Updated 7 months ago
• yikangshen / MoA
  Mixture of Attention Heads
  ☆41Updated 2 years ago
• lucasjinreal / LLaVA-Magvit2
  ☆35Updated 7 months ago
• Juanerx / Q-DiT
  PyTorch code for Q-DiT: Accurate Post-Training Quantization for Diffusion Transformers
  ☆36Updated 4 months ago
• huggingface / docmatix
  A huge dataset for Document Visual Question Answering
  ☆15Updated 5 months ago