This repository contains the code for the paper "TaylorShift: Shifting the Complexity of Self-Attention from Squared to Linear (and Back) using Taylor-Softmax"
☆15Feb 25, 2026Updated 8 months ago
Alternatives and similar repositories for TaylorShift
Users that are interested in TaylorShift are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation of the model "Hedgehog" from the paper: "The Hedgehog & the Porcupine: Expressive Linear Attentions with Softmax Mimicry"☆15Mar 11, 2024Updated 2 years ago
- Vstream - Video Analytics pipeline with Hardware based accelerations (dev - stage)☆10Feb 2, 2024Updated 2 years ago
- Public repository for "DCT-Former: Efficient Self-Attention withDiscrete Cosine Transform"☆18Mar 15, 2023Updated 3 years ago
- [EMNLP 2024] Quantize LLM to extremely low-bit, and finetune the quantized LLMs☆17Jul 18, 2024Updated 2 years ago
- ☆24Mar 1, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Convergent mobile+desktop application to help decide if food is still edible.☆11Nov 5, 2020Updated 6 years ago
- [ACL 2026] Official repo for "Native Hybrid Attention for Efficient Sequence Modeling"☆36Sep 17, 2026Updated 2 months ago
- Enhancing Parameter-Efficient Fine-Tuning of Vision Transformers through Frequency-Based Adaptation☆10Jan 29, 2025Updated last year
- (ACM MM24) This is the offical repository of GIST: Improving Parameter Efficient Fine Tuning via Knowledge Interaction.☆10Jan 28, 2024Updated 2 years ago
- Using tensorflow object detection api and openCV to calculate real world coordinates from top view with fixed height of the camera.☆10Jun 19, 2021Updated 5 years ago
- KAF : Kolmogorov-Arnold Fourier Networks☆23Feb 19, 2025Updated last year
- A server/client approach to face recognition. Aims to be fast, secure and iot friendly. Uses dlib.☆11May 7, 2021Updated 5 years ago
- HSViT: Horizontally Scalable Vision Transformer☆13Nov 6, 2024Updated 2 years ago
- [ICML'24 Oral] The official code of "DiJiang: Efficient Large Language Models through Compact Kernelization", a novel DCT-based linear at…☆105Jun 14, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- PDE-CNNs : Condensing CNNs with Partial Differential Equations☆10Jun 17, 2022Updated 4 years ago
- Track points in a video using the SIFT algorithm and OpenCV.☆13Jan 21, 2020Updated 6 years ago
- Explorations into the recently proposed Taylor Series Linear Attention☆102Aug 27, 2026Updated 2 months ago
- The official implementation for SETA (TIP 2024).☆12Feb 17, 2025Updated last year
- MonarchAttention: Zero-Shot Conversion to Fast, Hardware-Aware Structured Attention (NeurIPS'25 Spotlight)☆27Sep 25, 2026Updated last month
- NRLMFβ: Bata-distribution-rescored Neighborhood Regularized Logistic Matrix Factorization for Improving Performance of Drug–Target Intera…☆11Oct 12, 2021Updated 5 years ago
- temporary demo for RSAM-PT☆10Mar 22, 2025Updated last year
- This is the implementation of paper: SwinFG: A fine-grained recognition scheme based on swin transformer☆11Jan 4, 2024Updated 2 years ago
- ☆13Jul 3, 2024Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Transformer and Neural Operator for solving Stochastic PDE☆12May 22, 2022Updated 4 years ago
- DOneLogin Android: Facial verification for Two-Factors Authentication (2FA) on Android platform☆11Mar 30, 2021Updated 5 years ago
- Official implementation for Text Generation Beyond Discrete Token Sampling☆26Aug 11, 2025Updated last year
- Lightweight Transformer for Multi-modal Tasks☆16Dec 9, 2022Updated 3 years ago
- (ICME24) This is the offical repository of iDAT: inverse Distillation Adapter-Tuning.☆12Apr 3, 2024Updated 2 years ago
- Official implementation of RMoE (Layerwise Recurrent Router for Mixture-of-Experts)☆33Aug 4, 2024Updated 2 years ago
- Fine Grained Image Classification with Class Imbalance using Bilinear EfficientNet with Focal Loss and Label Smoothing☆10May 28, 2020Updated 6 years ago
- IREE compiler and runtime for Snitch☆15May 14, 2026Updated 6 months ago
- Official Implementation of "Circuit Transformer: A Transformer That Preserves Logical Equivalence"☆29Mar 13, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆33Nov 11, 2024Updated 2 years ago
- YOLOV3☆12Oct 20, 2020Updated 6 years ago
- ☆11Aug 31, 2023Updated 3 years ago
- Compile MLIR to PTX and execute it on NVIDIA GPUs☆11Apr 16, 2025Updated last year
- ☆15Aug 12, 2022Updated 4 years ago
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆39Nov 1, 2024Updated 2 years ago
- ☆13Feb 3, 2025Updated last year
Are these results useful?