Alternatives and similar repositories for softtopk:

Users that are interested in softtopk are comparing it to the libraries listed below

• fla-org / flash-bidirectional-linear-attention
  Triton implement of bi-directional (non-causal) linear attention
  ☆41Updated 2 weeks ago
• bojone / FSQ
  Keras implement of Finite Scalar Quantization
  ☆69Updated last year
• BBuf / flash-rwkv
  ☆30Updated 8 months ago
• HKUNLP / efficient-attention
  [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
  ☆80Updated last year
• HubHop / vit-attention-benchmark
  Benchmarking Attention Mechanism in Vision Transformers.
  ☆17Updated 2 years ago
• alihassanijr / TorchKMeans
  A torch-based implementation of K-Means and K-Means++
  ☆17Updated 4 years ago
• bojone / tiger
  A Tight-fisted Optimizer
  ☆47Updated last year
• donglixp / ICL_PaperList
  Paper List for In-context Learning 🌷
  ☆20Updated 2 years ago
• HelmholtzAI-FZJ / flex_gen
  ☆17Updated last month
• OpenNLPLab / Transnormer
  [EMNLP 2022] Official implementation of Transnormer in our EMNLP 2022 paper - The Devil in Linear Transformer
  ☆59Updated last year
• lucasjinreal / LLaVA-Magvit2
  LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.
  ☆35Updated 8 months ago
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated last year
• yikangshen / MoA
  Mixture of Attention Heads
  ☆41Updated 2 years ago
• GeeeekExplorer / cupytorch
  A small framework mimics PyTorch using CuPy or NumPy
  ☆27Updated 3 years ago
• JerryYin777 / Cross-Layer-Attention
  Self Reproduction Code of Paper "Reducing Transformer Key-Value Cache Size with Cross-Layer Attention (MIT CSAIL)
  ☆12Updated 8 months ago
• megvii-research / basedet
  An object detection codebase based on MegEngine.
  ☆28Updated 2 years ago
• Pepper-lll / LMforImageGeneration
  Codebase for the paper-Elucidating the design space of language models for image generation
  ☆45Updated 3 months ago
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆32Updated last year
• TIGER-AI-Lab / VISTA
  This repo contains code for "VISTA: Enhancing Long-Duration and High-Resolution Video Understanding by VIdeo SpatioTemporal Augmentation"
  ☆11Updated last month
• Optimization-AI / fast_clip
  ☆22Updated 4 months ago
• berlino / gated_linear_attention
  ☆99Updated 11 months ago
• csarron / PuMer
  [ACL 2023] PuMer: Pruning and Merging Tokens for Efficient Vision Language Models
  ☆29Updated 4 months ago
• OpenSparseLLMs / Open-Pandora
  Open-Pandora: On-the-fly Control Video Generation
  ☆32Updated 2 months ago
• MarkXCloud / CSpD
  The official repo of continuous speculative decoding
  ☆24Updated 3 months ago
• savadikarc / gift
  GIFT: Generative Interpretable Fine-Tuning
  ☆20Updated 4 months ago
• huggingface / docmatix
  A huge dataset for Document Visual Question Answering
  ☆15Updated 6 months ago
• 360CVGroup / Inner-Adaptor-Architecture
  LMM solved catastrophic forgetting, AAAI2025
  ☆38Updated 3 months ago
• OpenGVLab / DiffAgent
  [CVPR 2024] DiffAgent: Fast and Accurate Text-to-Image API Selection with Large Language Model
  ☆17Updated 10 months ago
• mjy1111 / PEAK
  The repository for our paper: Neighboring Perturbations of Knowledge Editing on Large Language Models
  ☆16Updated 9 months ago
• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆28Updated 8 months ago