bojone / softtopk
differentiable top-k operator
☆21Updated 3 months ago
Alternatives and similar repositories for softtopk:
Users that are interested in softtopk are comparing it to the libraries listed below
- Triton implement of bi-directional (non-causal) linear attention☆46Updated 2 months ago
- ☆30Updated 11 months ago
- Keras implement of Finite Scalar Quantization☆71Updated last year
- IntLLaMA: A fast and light quantization solution for LLaMA☆18Updated last year
- A torch-based implementation of K-Means and K-Means++☆17Updated 4 years ago
- A tiny, didactical implementation of LLAMA 3☆39Updated 4 months ago
- ☆17Updated 3 months ago
- Codebase for the paper-Elucidating the design space of language models for image generation☆45Updated 5 months ago
- Benchmarking Attention Mechanism in Vision Transformers.☆17Updated 2 years ago
- [ICLR 2025] Official PyTorch implementation of "Forgetting Transformer: Softmax Attention with a Forget Gate"☆95Updated 2 weeks ago
- Self Reproduction Code of Paper "Reducing Transformer Key-Value Cache Size with Cross-Layer Attention (MIT CSAIL)☆13Updated 11 months ago
- Paper List for In-context Learning 🌷☆20Updated 2 years ago
- LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.☆38Updated 10 months ago
- A Tight-fisted Optimizer☆47Updated 2 years ago
- [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling☆84Updated 2 years ago
- A small framework mimics PyTorch using CuPy or NumPy☆27Updated 3 years ago
- An object detection codebase based on MegEngine.☆28Updated 2 years ago
- GIFT: Generative Interpretable Fine-Tuning☆20Updated 6 months ago
- [ECCV 2024] This is the official implementation of "Stitched ViTs are Flexible Vision Backbones".☆27Updated last year
- # Unified Normalization (ACM MM'22) By Qiming Yang, Kai Zhang, Chaoxiang Lan, Zhi Yang, Zheyang Li, Wenming Tan, Jun Xiao, and Shiliang P…☆34Updated 2 years ago
- Mixture of Attention Heads☆44Updated 2 years ago
- A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.☆34Updated 10 months ago
- An official pytorch implementation of AAAI 2024 paper "Latent Space Editing in Transformer-based Flow Matching"☆36Updated last year
- Document the demo and a series of documents for learning the diffusion model.☆39Updated last year
- Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.☆32Updated last year
- ICME2022 Special Session “Beyond Accuracy: Responsible, Responsive, and Robust Multimedia Retrieval ”☆12Updated 10 months ago
- [EMNLP 2022] Official implementation of Transnormer in our EMNLP 2022 paper - The Devil in Linear Transformer☆60Updated last year
- [CVPR2023] This is an official implementation of paper "DETRs with Hybrid Matching".☆14Updated 2 years ago
- Unofficial PyTorch implementation of the paper "cosFormer: Rethinking Softmax In Attention".☆44Updated 3 years ago
- [CVPR 2024] DiffAgent: Fast and Accurate Text-to-Image API Selection with Large Language Model☆17Updated last year