nowazrabbani / pMoE_CNNLinks
The official repository for the experiments included in the paper titled "Patch-level Routing in Mixture-of-Experts is Provably Sample-efficient for Convolutional Neural Networks" [ICML, 2023]
☆13Updated 2 years ago
Alternatives and similar repositories for pMoE_CNN
Users that are interested in pMoE_CNN are comparing it to the libraries listed below
Sorting:
- BESA is a differentiable weight pruning technique for large language models.☆17Updated last year
- [ICCV 23]An approach to enhance the efficiency of Vision Transformer (ViT) by concurrently employing token pruning and token merging tech…☆99Updated 2 years ago
- The official implementation of "2024NeurIPS Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation"☆46Updated 8 months ago
- [NeurIPS 2024] Search for Efficient LLMs☆14Updated 7 months ago
- This repo contains the source code for VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks (NeurIPS 2024).☆40Updated 10 months ago
- [ICML 2024] CrossGET: Cross-Guided Ensemble of Tokens for Accelerating Vision-Language Transformers.☆34Updated 8 months ago
- ☆113Updated last year
- [CVPR 2023] Castling-ViT: Compressing Self-Attention via Switching Towards Linear-Angular Attention During Vision Transformer Inference☆30Updated last year
- The official implementation for MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning (CVPR '24)☆60Updated last month
- ☆27Updated 2 years ago
- ☆26Updated last year
- Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆104Updated this week
- Unsupervised GRPO☆46Updated 2 months ago
- [CVPR2024] Efficient Dataset Distillation via Minimax Diffusion☆96Updated last year
- [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models☆126Updated last month
- Official PyTorch implementation of Which Tokens to Use? Investigating Token Reduction in Vision Transformers presented at ICCV 2023 NIVT …☆34Updated 2 years ago
- Collect papers about Mamba (a selective state space model).☆14Updated last year
- Awesome-Low-Rank-Adaptation☆115Updated 10 months ago
- ICLR 2024, Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matching☆101Updated last year
- ☆47Updated 2 years ago
- [NeurIPS2023] Parameter-efficient Tuning of Large-scale Multimodal Foundation Model☆88Updated last year
- [ICLR24] AutoVP: An Automated Visual Prompting Framework and Benchmark☆20Updated 3 months ago
- The codebase for paper "PPT: Token Pruning and Pooling for Efficient Vision Transformer"☆25Updated 9 months ago
- Code for "DAMEX: Dataset-aware Mixture-of-Experts for visual understanding of mixture-of-datasets", accepted at Neurips 2023 (Main confer…☆22Updated last year
- [ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.☆72Updated last year
- A repository for DenseSSMs☆88Updated last year
- Structured Pruning Adapters in PyTorch☆19Updated 2 years ago
- Code for "ECoFLaP: Efficient Coarse-to-Fine Layer-Wise Pruning for Vision-Language Models" (ICLR 2024)☆19Updated last year
- Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…☆49Updated last year
- [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference☆44Updated last year