This repository contains the code for the paper "TaylorShift: Shifting the Complexity of Self-Attention from Squared to Linear (and Back) using Taylor-Softmax"
☆15Feb 25, 2026Updated 8 months ago
Alternatives and similar repositories for TaylorShift
Users that are interested in TaylorShift are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Github repository for the paper Which Transformer to Favor: A Comparative Analysis of Efficiency in Vision Transformers.☆33Feb 25, 2026Updated 8 months ago
- [EMNLP 2024] Quantize LLM to extremely low-bit, and finetune the quantized LLMs☆17Jul 18, 2024Updated 2 years ago
- Vstream - Video Analytics pipeline with Hardware based accelerations (dev - stage)☆10Feb 2, 2024Updated 2 years ago
- Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)☆25Jun 6, 2024Updated 2 years ago
- [ACL 2026] Official repo for "Native Hybrid Attention for Efficient Sequence Modeling"☆35Sep 17, 2026Updated last month
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Convergent mobile+desktop application to help decide if food is still edible.☆11Nov 5, 2020Updated 5 years ago
- Adaptation of titans-pytorch to llama models on HF☆26Mar 6, 2025Updated last year
- [IJCV2023] Offical implementation of "SCT: A Simple Baseline for Parameter-Efficient Fine-Tuning via Salient Channels"☆12Sep 18, 2023Updated 3 years ago
- (ACM MM24) This is the offical repository of GIST: Improving Parameter Efficient Fine Tuning via Knowledge Interaction.☆10Jan 28, 2024Updated 2 years ago
- KAF : Kolmogorov-Arnold Fourier Networks☆24Feb 19, 2025Updated last year
- Transformer and Neural Operator for solving Stochastic PDE☆12May 22, 2022Updated 4 years ago
- The official implementation for SETA (TIP 2024).☆12Feb 17, 2025Updated last year
- MonarchAttention: Zero-Shot Conversion to Fast, Hardware-Aware Structured Attention (NeurIPS'25 Spotlight)☆27Sep 25, 2026Updated last month
- Fight detection using pose estimation, limb angle calculation and LSTM☆11Oct 20, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- NRLMFβ: Bata-distribution-rescored Neighborhood Regularized Logistic Matrix Factorization for Improving Performance of Drug–Target Intera…☆11Oct 12, 2021Updated 5 years ago
- ☆13Jul 3, 2024Updated 2 years ago
- DOneLogin Android: Facial verification for Two-Factors Authentication (2FA) on Android platform☆11Mar 30, 2021Updated 5 years ago
- This is the implementation of Embedded Prompt Tuning(EPT).☆14Feb 10, 2025Updated last year
- Basic image/video processing utilities in Python.☆12Apr 19, 2021Updated 5 years ago
- (ICME24) This is the offical repository of iDAT: inverse Distillation Adapter-Tuning.☆12Apr 3, 2024Updated 2 years ago
- Retargetable ML compilers for the twenty-first century!☆13Apr 22, 2025Updated last year
- Smart Waste Management System using IoT☆11Jan 9, 2023Updated 3 years ago
- A tiny FP8 multiplication unit written in Verilog. TinyTapeout 2 submission.☆14Nov 23, 2022Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Implementation of NIPS2023: Unleashing the Full Potential of Product Quantization for Large-Scale Image Retrieva☆11Nov 12, 2024Updated last year
- ☆33Nov 11, 2024Updated last year
- IREE compiler and runtime for Snitch☆15May 14, 2026Updated 5 months ago
- ☆15Aug 12, 2022Updated 4 years ago
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆39Nov 1, 2024Updated 2 years ago
- Repository for ICLR'23 Long-tailed Learning Requires Feature Learning☆10Feb 22, 2023Updated 3 years ago
- Offical implementation of "MetaLA: Unified Optimal Linear Approximation to Softmax Attention Map" (NeurIPS2024 Oral)☆36Jan 18, 2025Updated last year
- ☆42Oct 13, 2021Updated 5 years ago
- ☆12Mar 23, 2022Updated 4 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- [Codes of paper]: Busy-Quiet Video Disentangling for Video Classification☆14Jan 17, 2022Updated 4 years ago
- Official implementation for "SimA: Simple Softmax-free Attention for Vision Transformers"☆48Apr 18, 2024Updated 2 years ago
- Work in progress.☆82Nov 25, 2025Updated 11 months ago
- NeRF (Neural Radiance Field) TensorFlow v2 Keras Re-Implementation☆11Dec 15, 2022Updated 3 years ago
- Normalize CJK characters in text☆14Sep 30, 2025Updated last year
- Experiments Notebook of "Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism"☆17Apr 30, 2025Updated last year
- Porting Postgres Server to WASM [WIP]☆16Mar 6, 2021Updated 5 years ago