[CVPR 2023] Castling-ViT: Compressing Self-Attention via Switching Towards Linear-Angular Attention During Vision Transformer Inference
☆31Mar 14, 2024Updated 2 years ago
Alternatives and similar repositories for Castling-ViT
Users that are interested in Castling-ViT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official Implementation of the CVPR'23 paper 'Regularization of polynomial networks for image recognition'.☆10Jun 8, 2023Updated 3 years ago
- ☆21May 7, 2024Updated 2 years ago
- PyTorch implementation of PaCa-ViT (CVPR'23)☆36Apr 22, 2023Updated 3 years ago
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"☆74Nov 15, 2022Updated 3 years ago
- 本项目是关于Yi的多模态系列模型，如Yi-VL-6B/34B等的实验与应用。☆14Jan 25, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆14Sep 7, 2024Updated 2 years ago
- Official PyTorch implementation of our ECCV 2022 paper "Sliced Recursive Transformer"☆67Sep 6, 2022Updated 4 years ago
- ☆17Jun 11, 2025Updated last year
- Official implementation for "SimA: Simple Softmax-free Attention for Vision Transformers"☆48Apr 18, 2024Updated 2 years ago
- ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization☆114Oct 15, 2024Updated last year
- [ICCV2023] Spatio-temporal Prompting Network for Robust Video Feature Extraction☆11Aug 17, 2023Updated 3 years ago
- [ICML 2024] Official PyTorch implementation of "SLAB: Efficient Transformers with Simplified Linear Attention and Progressive Re-paramete…☆110Aug 23, 2024Updated 2 years ago
- Single-Source Domain Generalization for Bearing Fault Diagnosis Using Feature-Augmented Adaptive Neuro-Fuzzy Inference System☆12Apr 13, 2024Updated 2 years ago
- CMT Pytorch implementation of our CVPR 2022 paper CMT: Convolutional Neural Networks Meet Vision Transformers (https://arxiv.org/pdf/2107…☆101Jul 1, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆10Oct 28, 2024Updated last year
- ☆16Jan 30, 2025Updated last year
- Arrow Matrix Decomposition - Communication-Efficient Distributed Sparse Matrix Multiplication☆15Mar 25, 2024Updated 2 years ago
- [ECCV’24] Official repository for "BEAF: Observing Before-AFter Changes to Evaluate Hallucination in Vision-language Models"☆22Mar 26, 2025Updated last year
- A probabilitic model for contextual word representation. Accepted to ACL2023 Findings.☆25Oct 22, 2023Updated 2 years ago
- ☆27May 22, 2024Updated 2 years ago
- [ICCV 2023] Source code of "Fcaformer: Forward Cross Attention in Hybrid Vision Transformer"☆25Aug 23, 2023Updated 3 years ago
- CycleQD is a framework for parameter space model merging.☆48Feb 1, 2025Updated last year
- Pytorch Code for the CVPR2020 paper: "Perceptual Quality Assessment of Smartphone Photography."☆16Dec 9, 2020Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ICCV 2023] Official repository of FLatten Transformer☆448Nov 4, 2024Updated last year
- Implementation of: Hydra Attention: Efficient Attention with Many Heads (https://arxiv.org/abs/2209.07484)☆14Jan 8, 2023Updated 3 years ago
- Official implementation for Sparse MetA-Tuning (SMAT)☆17Jul 29, 2025Updated last year
- [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…☆45Jun 30, 2024Updated 2 years ago
- PyTorch implementation of StableMask (ICML'24)☆15Jun 27, 2024Updated 2 years ago
- [CVPR 2025] CoDe: Collaborative Decoding Makes Visual Auto-Regressive Modeling Efficient☆109Sep 27, 2025Updated last year
- HyperBCS: Biscale Convolutional Self-Attention Network for Hyperspectral Coastal Wetlands Classification☆12May 9, 2025Updated last year
- [NeurIPS 2023] ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer☆31Dec 6, 2023Updated 2 years ago
- Code For Volterra Neural Networks☆13Dec 17, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- WavSpA: Wavelet Space Attention for Enhancing Transformer's Long Sequence Learning☆13Feb 24, 2024Updated 2 years ago
- HGRN2: Gated Linear RNNs with State Expansion☆59Aug 20, 2024Updated 2 years ago
- [CVPR2023] "SMPConv: Self-moving Point Representations for Continuous Convolution"☆56May 29, 2023Updated 3 years ago
- An open-sourced PyTorch library for developing energy efficient multiplication-less models and applications.☆14Feb 3, 2025Updated last year
- Hypernetwork training considerations and implementation types in PyTorch. Includes classification and time-series examples alongside 1D G…☆25Jan 4, 2023Updated 3 years ago
- TCM: Temporal Correlation Module☆17Apr 24, 2021Updated 5 years ago
- Code Repository for the NeurIPS 2022 paper: "Hyper-Representations as Generative Models: Sampling Unseen Neural Network Weights".☆19Jul 10, 2024Updated 2 years ago