bojone / softtopkLinks
differentiable top-k operator
☆21Updated 5 months ago
Alternatives and similar repositories for softtopk
Users that are interested in softtopk are comparing it to the libraries listed below
Sorting:
- Keras implement of Finite Scalar Quantization☆73Updated last year
- LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.☆37Updated 11 months ago
- Triton implement of bi-directional (non-causal) linear attention☆49Updated 4 months ago
- ☆31Updated last year
- A tiny, didactical implementation of LLAMA 3☆40Updated 6 months ago
- IntLLaMA: A fast and light quantization solution for LLaMA☆18Updated last year
- Mixture of Attention Heads☆44Updated 2 years ago
- ☆17Updated 4 months ago
- ☆42Updated 4 years ago
- [EMNLP 2022] Official implementation of Transnormer in our EMNLP 2022 paper - The Devil in Linear Transformer☆60Updated last year
- Open-Pandora: On-the-fly Control Video Generation☆34Updated 6 months ago
- A small framework mimics PyTorch using CuPy or NumPy☆27Updated 3 years ago
- Self Reproduction Code of Paper "Reducing Transformer Key-Value Cache Size with Cross-Layer Attention (MIT CSAIL)☆16Updated last year
- A torch-based implementation of K-Means and K-Means++☆17Updated 4 years ago
- ☆17Updated last year
- Benchmarking Attention Mechanism in Vision Transformers.☆18Updated 2 years ago
- Accelerate LLM preference tuning via prefix sharing with a single line of code☆41Updated last month
- GIFT: Generative Interpretable Fine-Tuning☆20Updated 7 months ago
- Codebase for the paper-Elucidating the design space of language models for image generation☆45Updated 6 months ago
- [ICLR 2025] Official PyTorch implementation of "Forgetting Transformer: Softmax Attention with a Forget Gate"☆107Updated 3 weeks ago
- Official Code for "Rethinking Diffusion Model in High Dimension"☆14Updated 2 weeks ago
- [ICLR'25] "Understanding Bottlenecks of State Space Models through the Lens of Recency and Over-smoothing" by Peihao Wang, Ruisi Cai, Yue…☆11Updated 2 months ago
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*☆20Updated last week
- A Tight-fisted Optimizer☆48Updated 2 years ago
- A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.☆35Updated 11 months ago
- [ICLR 2025] MiniPLM: Knowledge Distillation for Pre-Training Language Models☆47Updated 6 months ago
- Document the demo and a series of documents for learning the diffusion model.☆39Updated last year
- ☆16Updated 2 years ago
- [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling☆85Updated 2 years ago
- Paper List for In-context Learning 🌷☆20Updated 2 years ago