[CVPR 2023] Castling-ViT: Compressing Self-Attention via Switching Towards Linear-Angular Attention During Vision Transformer Inference
☆31Mar 14, 2024Updated 2 years ago
Alternatives and similar repositories for Castling-ViT
Users that are interested in Castling-ViT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆21May 7, 2024Updated 2 years ago
- [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models☆35Jun 12, 2024Updated 2 years ago
- ☆10Dec 13, 2022Updated 3 years ago
- Implementation for paper Automata Extraction from Transformers.☆12Jun 8, 2024Updated 2 years ago
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"☆74Nov 15, 2022Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- 本项目是关于Yi的多模态系列模型，如Yi-VL-6B/34B等的实验与应用。☆14Jan 25, 2024Updated 2 years ago
- ☆14Sep 7, 2024Updated last year
- Official PyTorch implementation of our ECCV 2022 paper "Sliced Recursive Transformer"☆66Sep 6, 2022Updated 3 years ago
- ☆16Jun 11, 2025Updated last year
- [ECCV 2022] SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning☆20Jul 7, 2022Updated 4 years ago
- ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization☆114Oct 15, 2024Updated last year
- Official repository of Slide-Transformer (CVPR2023)☆171Aug 27, 2024Updated last year
- TiC: Exploring Vision Transformer in Convolution☆11Oct 24, 2023Updated 2 years ago
- [ICML 2024] Official PyTorch implementation of "SLAB: Efficient Transformers with Simplified Linear Attention and Progressive Re-paramete…☆110Aug 23, 2024Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- CMT Pytorch implementation of our CVPR 2022 paper CMT: Convolutional Neural Networks Meet Vision Transformers (https://arxiv.org/pdf/2107…☆101Jul 1, 2022Updated 4 years ago
- ResMLP: Feedforward networks for image classification with data-efficient training☆46May 10, 2021Updated 5 years ago
- ☆10Oct 28, 2024Updated last year
- ☆16Jan 30, 2025Updated last year
- [ECCV’24] Official repository for "BEAF: Observing Before-AFter Changes to Evaluate Hallucination in Vision-language Models"☆22Mar 26, 2025Updated last year
- CycleQD is a framework for parameter space model merging.☆48Feb 1, 2025Updated last year
- Pytorch Code for the CVPR2020 paper: "Perceptual Quality Assessment of Smartphone Photography."☆16Dec 9, 2020Updated 5 years ago
- ☆48Aug 7, 2023Updated 2 years ago
- Official implementation for Sparse MetA-Tuning (SMAT)☆17Jul 29, 2025Updated 11 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…☆45Jun 30, 2024Updated 2 years ago
- PyTorch implementation of StableMask (ICML'24)☆15Jun 27, 2024Updated 2 years ago
- [CVPR 2025] CoDe: Collaborative Decoding Makes Visual Auto-Regressive Modeling Efficient☆108Sep 27, 2025Updated 9 months ago
- HyperBCS: Biscale Convolutional Self-Attention Network for Hyperspectral Coastal Wetlands Classification☆12May 9, 2025Updated last year
- [NeurIPS 2023] ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer☆30Dec 6, 2023Updated 2 years ago
- Official code for "Defense Against Adversarial Attacks on No-Reference Image Quality Models with Gradient Norm Regularization"☆17Aug 7, 2024Updated last year
- Code for ACL 2022 findings paper "Gaussian Multi-head Attention for Simultaneous Machine Translation"☆11Mar 31, 2022Updated 4 years ago
- WavSpA: Wavelet Space Attention for Enhancing Transformer's Long Sequence Learning☆13Feb 24, 2024Updated 2 years ago
- HGRN2: Gated Linear RNNs with State Expansion☆58Aug 20, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The source code (Pytorch version) of paper "Multi-modality augmented Prototypical Network for Fault Diagnosis"☆11Aug 26, 2024Updated last year
- Hypernetwork training considerations and implementation types in PyTorch. Includes classification and time-series examples alongside 1D G…☆25Jan 4, 2023Updated 3 years ago
- TCM: Temporal Correlation Module☆17Apr 24, 2021Updated 5 years ago
- CS, AI, ML, DL 기술 면접 대비 질의 응답 레포지토리☆13Jul 14, 2022Updated 4 years ago
- Code Repository for the NeurIPS 2022 paper: "Hyper-Representations as Generative Models: Sampling Unseen Neural Network Weights".☆18Jul 10, 2024Updated 2 years ago
- [AAAI 2024] Transformer-Based No-Reference Image Quality Assessment via Supervised Contrastive Learning☆14Feb 20, 2024Updated 2 years ago
- EATFormer: Improving Vision Transformer Inspired by Evolutionary Algorithm☆35Aug 18, 2022Updated 3 years ago