pprp / Awesome-Efficient-MoE
☆16Updated this week
Related projects ⓘ
Alternatives and complementary repositories for Awesome-Efficient-MoE
- [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference☆28Updated 5 months ago
- Adapting LLaMA Decoder to Vision Transformer☆27Updated 6 months ago
- [MM2024, oral] "Self-Supervised Visual Preference Alignment" https://arxiv.org/abs/2404.10501☆41Updated 3 months ago
- ☆23Updated 3 months ago
- ☆77Updated 4 months ago
- The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…☆55Updated last month
- ICCV'23 | Adverse Weather Removal with Codebook Priors☆10Updated last year
- Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)☆40Updated last week
- Awesome-Low-Rank-Adaptation☆40Updated last month
- [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…☆36Updated 8 months ago
- [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…☆59Updated 7 months ago
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆105Updated 2 months ago
- BESA is a differentiable weight pruning technique for large language models.☆14Updated 8 months ago
- [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning☆80Updated last week
- Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…☆37Updated 7 months ago
- This is a repo to track the latest autoregressive visual generation papers.☆50Updated this week
- super-resolution; post-training quantization; model compression☆10Updated last year
- This repository provides an improved LLamaGen Model, fine-tuned on 500,000 high-quality images, each accompanied by over 300 token prompt…☆27Updated last month
- Activation-aware Singular Value Decomposition for Compressing Large Language Models☆49Updated last month
- A Survey on Benchmarks of Multimodal Large Language Models☆66Updated last month
- A repository for DenseSSMs☆88Updated 7 months ago
- Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation, ICML 2024☆21Updated 4 months ago
- [CVPR 2024] DiffAgent: Fast and Accurate Text-to-Image API Selection with Large Language Model☆16Updated 7 months ago
- [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment☆51Updated last month
- code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"☆15Updated 6 months ago
- ☆34Updated last month
- The official code of the paper "PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction".☆45Updated 3 weeks ago
- [ICML 2024] SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models☆16Updated 5 months ago
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆74Updated last month