ylsung / Ladder-Side-Tuning
PyTorch codes for "LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learning"
☆229Updated last year
Related projects: ⓘ
- [NeurIPS'22] This is an official implementation for "Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuning".☆163Updated 11 months ago
- Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)☆511Updated 2 years ago
- Recent Advances in Vision and Language Pre-training (VLP)☆287Updated last year
- All-In-One VLM: Image + Video + Transfer to Other Languages / Domains (TPAMI 2023)☆131Updated 3 weeks ago
- ☆139Updated 2 months ago
- PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)☆202Updated last year
- The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆166Updated 5 months ago
- SVIT: Scaling up Visual Instruction Tuning☆159Updated 3 months ago
- 😎 up-to-date & curated list of awesome LMM hallucinations papers, methods & resources.☆140Updated 5 months ago
- ☆149Updated 3 years ago
- Official code for our CVPR'22 paper “Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space”☆243Updated 10 months ago
- [TPAMI] Searching prompt modules for parameter-efficient transfer learning.☆216Updated 9 months ago
- MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning☆131Updated last year
- ☆113Updated last year
- A collection of parameter-efficient transfer learning papers focusing on computer vision and multimodal domains.☆388Updated 2 months ago
- Experiments and data for the paper "When and why vision-language models behave like bags-of-words, and what to do about it?" Oral @ ICLR …☆234Updated last year
- This is the first released survey paper on hallucinations of large vision-language models (LVLMs). To keep track of this field and contin…☆32Updated last month
- [ICML 2023] UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers.☆94Updated 10 months ago
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).☆253Updated last year
- METER: A Multimodal End-to-end TransformER Framework☆360Updated last year
- Official implementation for the paper "Prompt Pre-Training with Over Twenty-Thousand Classes for Open-Vocabulary Visual Recognition"☆251Updated 4 months ago
- MixGen: A New Multi-Modal Data Augmentation☆112Updated last year
- [ICCV2023] Dataset Quantization☆248Updated 8 months ago
- A RLHF Infrastructure for Vision-Language Models☆86Updated 3 months ago
- Code for paper "UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning", ACL 2022☆58Updated 2 years ago
- Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning☆168Updated 4 months ago
- Dataset pruning for ImageNet and LAION-2B.☆62Updated 2 months ago
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆191Updated 4 months ago
- [NeurIPS 2023] Text data, code and pre-trained models for paper "Improving CLIP Training with Language Rewrites"☆251Updated 8 months ago
- [CVPR 2024 Highlight] Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding☆177Updated 2 months ago