foundation-multimodal-models / ConBench
Official implementation of paper "Unveiling the Tapestry of Consistency in Large Vision-Language Models", NeurIPS 2024.
☆30Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for ConBench
- ☆108Updated 5 months ago
- Official implementation of paper "SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inference" proposed by Pekin…☆50Updated 2 weeks ago
- A paper list of some recent works about Token Compress for Vit and VLM☆128Updated this week
- [ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.☆62Updated last year
- A collection of visual instruction tuning datasets.☆76Updated 7 months ago
- ☆21Updated 2 months ago
- official impelmentation of Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Input☆54Updated 2 months ago
- ☆84Updated 11 months ago
- Official PyTorch implementation of Which Tokens to Use? Investigating Token Reduction in Vision Transformers presented at ICCV 2023 NIVT …☆30Updated last year
- ☆78Updated 9 months ago
- Code for "DAMEX: Dataset-aware Mixture-of-Experts for visual understanding of mixture-of-datasets", accepted at Neurips 2023 (Main confer…☆21Updated 7 months ago
- LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models☆98Updated 5 months ago
- Code release for Deep Incubation (https://arxiv.org/abs/2212.04129)☆91Updated last year
- Implementation of "VL-Mamba: Exploring State Space Models for Multimodal Learning"☆77Updated 7 months ago
- Dataset pruning for ImageNet and LAION-2B.☆68Updated 4 months ago
- ☆15Updated 3 months ago
- [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"☆52Updated last year
- VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation☆84Updated last month
- Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models☆36Updated last year
- [ICLR2024] Exploring Target Representations for Masked Autoencoders☆52Updated 9 months ago
- Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMs☆76Updated 4 months ago
- [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment☆48Updated last month
- A RLHF Infrastructure for Vision-Language Models☆98Updated 4 months ago
- Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning☆65Updated 4 months ago
- [CVPR2024] The code of "UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory"☆64Updated 3 weeks ago
- SVIT: Scaling up Visual Instruction Tuning☆163Updated 4 months ago
- The paper collections for the autoregressive models in vision.☆95Updated this week
- The official implementation of 《MLLMs-Augmented Visual-Language Representation Learning》☆31Updated 7 months ago
- [NeurIPS'22] This is an official implementation for "Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuning".☆172Updated last year
- [EMNLP 2024 Findings🔥] Official implementation of "LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Infe…☆75Updated last week