Alternatives and similar repositories for softtopk:

Users that are interested in softtopk are comparing it to the libraries listed below

• fla-org / flash-bidirectional-linear-attention
  Triton implement of bi-directional (non-causal) linear attention
  ☆44Updated last month
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated last year
• BBuf / flash-rwkv
  ☆30Updated 10 months ago
• HelmholtzAI-FZJ / flex_gen
  ☆17Updated 2 months ago
• bojone / FSQ
  Keras implement of Finite Scalar Quantization
  ☆71Updated last year
• CompVis / DisCLIP
  Does VLM Classification Benefit from LLM Description Semantics? (AAAI 2025)
  ☆16Updated 2 months ago
• HubHop / vit-attention-benchmark
  Benchmarking Attention Mechanism in Vision Transformers.
  ☆17Updated 2 years ago
• savadikarc / gift
  GIFT: Generative Interpretable Fine-Tuning
  ☆20Updated 5 months ago
• zhixuan-lin / forgetting-transformer
  [ICLR 2025] Official PyTorch implementation of "Forgetting Transformer: Softmax Attention with a Forget Gate"
  ☆76Updated last week
• alihassanijr / TorchKMeans
  A torch-based implementation of K-Means and K-Means++
  ☆17Updated 4 years ago
• philippe-eecs / small-vision
  A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.
  ☆34Updated 9 months ago
• yikangshen / MoA
  Mixture of Attention Heads
  ☆43Updated 2 years ago
• kyegomez / Blockwise-Parallel-Transformer
  32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.
  ☆46Updated last year
• yuweihao / LV-BERT
  LV-BERT: Exploiting Layer Variety for BERT (Findings of ACL 2021)
  ☆18Updated last year
• facebookresearch / ViP-MAE
  This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision
  ☆36Updated last year
• JerryYin777 / Cross-Layer-Attention
  Self Reproduction Code of Paper "Reducing Transformer Key-Value Cache Size with Cross-Layer Attention (MIT CSAIL)
  ☆12Updated 10 months ago
• WOWNICE / ssl-small
  Code implementation for paper "On the Efficacy of Small Self-Supervised Contrastive Models without Distillation Signals".
  ☆16Updated 3 years ago
• Aleph-Alpha / NeurIPS-WANT-submission-efficient-parallelization-layouts
  ☆22Updated last year
• HKUNLP / efficient-attention
  [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
  ☆82Updated 2 years ago
• donglixp / ICL_PaperList
  Paper List for In-context Learning 🌷
  ☆20Updated 2 years ago
• dongzhuoyao / uspace
  An official pytorch implementation of AAAI 2024 paper "Latent Space Editing in Transformer-based Flow Matching"
  ☆36Updated 11 months ago
• sail-sg / ScaleLong
  The official repository of paper "ScaleLong: Towards More Stable Training of Diffusion Model via Scaling Network Long Skip Connection" (N…
  ☆50Updated last year
• mjy1111 / PEAK
  The repository for our paper: Neighboring Perturbations of Knowledge Editing on Large Language Models
  ☆16Updated 10 months ago
• Pepper-lll / LMforImageGeneration
  Codebase for the paper-Elucidating the design space of language models for image generation
  ☆45Updated 4 months ago
• shaoshitong / diffusion-model-learning
  Document the demo and a series of documents for learning the diffusion model.
  ☆39Updated last year
• GeeeekExplorer / cupytorch
  A small framework mimics PyTorch using CuPy or NumPy
  ☆27Updated 3 years ago
• berlino / gated_linear_attention
  ☆102Updated last year
• MarkXCloud / CSpD
  The official repo of continuous speculative decoding
  ☆25Updated 4 months ago
• Optimization-AI / fast_clip
  ☆23Updated 5 months ago
• pprp / Awesome-Efficient-MoE
  Efficient Mixture of Experts for LLM Paper List
  ☆47Updated 3 months ago