Alternatives and similar repositories for softtopk

Users that are interested in softtopk are comparing it to the libraries listed below

• bojone / FSQ
  Keras implement of Finite Scalar Quantization
  ☆71Updated last year
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated last year
• fla-org / flash-bidirectional-linear-attention
  Triton implement of bi-directional (non-causal) linear attention
  ☆47Updated 3 months ago
• BBuf / flash-rwkv
  ☆30Updated 11 months ago
• zhixuan-lin / forgetting-transformer
  [ICLR 2025] Official PyTorch implementation of "Forgetting Transformer: Softmax Attention with a Forget Gate"
  ☆99Updated this week
• lucasjinreal / LLaVA-Magvit2
  LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.
  ☆38Updated 10 months ago
• HubHop / vit-attention-benchmark
  Benchmarking Attention Mechanism in Vision Transformers.
  ☆18Updated 2 years ago
• hikvision-research / Unified-Normalization
  # Unified Normalization (ACM MM'22) By Qiming Yang, Kai Zhang, Chaoxiang Lan, Zhi Yang, Zheyang Li, Wenming Tan, Jun Xiao, and Shiliang P…
  ☆34Updated 2 years ago
• vedaldi / micro_llama
  A tiny, didactical implementation of LLAMA 3
  ☆40Updated 5 months ago
• alihassanijr / TorchKMeans
  A torch-based implementation of K-Means and K-Means++
  ☆17Updated 4 years ago
• megvii-research / basedet
  An object detection codebase based on MegEngine.
  ☆28Updated 2 years ago
• bojone / tiger
  A Tight-fisted Optimizer
  ☆47Updated 2 years ago
• HKUNLP / efficient-attention
  [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
  ☆85Updated 2 years ago
• yikangshen / MoA
  Mixture of Attention Heads
  ☆44Updated 2 years ago
• HelmholtzAI-FZJ / flex_gen
  ☆17Updated 4 months ago
• donglixp / ICL_PaperList
  Paper List for In-context Learning 🌷
  ☆20Updated 2 years ago
• shaoshitong / diffusion-model-learning
  Document the demo and a series of documents for learning the diffusion model.
  ☆39Updated last year
• philippe-eecs / small-vision
  A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.
  ☆35Updated 10 months ago
• GeeeekExplorer / cupytorch
  A small framework mimics PyTorch using CuPy or NumPy
  ☆27Updated 3 years ago
• lucasjinreal / ImageTokenizer
  imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…
  ☆34Updated 10 months ago
• thunlp / SparsingLaw
  The open-source materials for paper "Sparsing Law: Towards Large Language Models with Greater Activation Sparsity".
  ☆21Updated 6 months ago
• OpenNLPLab / Transnormer
  [EMNLP 2022] Official implementation of Transnormer in our EMNLP 2022 paper - The Devil in Linear Transformer
  ☆60Updated last year
• cheneydon / efficient-bert
  This repository contains the code for the paper in Findings of EMNLP 2021: "EfficientBERT: Progressively Searching Multilayer Perceptron …
  ☆32Updated last year
• dongzhuoyao / uspace
  An official pytorch implementation of AAAI 2024 paper "Latent Space Editing in Transformer-based Flow Matching"
  ☆40Updated last year
• OpenGVLab / DiffAgent
  [CVPR 2024] DiffAgent: Fast and Accurate Text-to-Image API Selection with Large Language Model
  ☆17Updated last year
• ziplab / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆27Updated last year
• MingSun-Tse / Why-the-State-of-Pruning-so-Confusing
  [Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Prunin…
  ☆40Updated 2 years ago
• Aleph-Alpha-Research / NeurIPS-WANT-submission-efficient-parallelization-layouts
  ☆22Updated last year
• VITA-Group / SSM-Bottleneck
  [ICLR'25] "Understanding Bottlenecks of State Space Models through the Lens of Recency and Over-smoothing" by Peihao Wang, Ruisi Cai, Yue…
  ☆11Updated last month
• yyyyychen / LowMemoryBP
  The official implementation of the paper "Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing Backpropagation"
  ☆20Updated 5 months ago