ylsung / vl-mergingLinks
PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"
☆38Updated last year
Alternatives and similar repositories for vl-merging
Users that are interested in vl-merging are comparing it to the libraries listed below
Sorting:
- Source code for the paper "Prefix Language Models are Unified Modal Learners"☆43Updated 2 years ago
- Self-Supervised Alignment with Mutual Information☆18Updated last year
- Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"☆31Updated last year
- Offcial Repo of Paper "Eliminating Position Bias of Language Models: A Mechanistic Approach""☆14Updated 9 months ago
- Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073☆28Updated 10 months ago
- Public code repo for EMNLP 2024 Findings paper "MACAROON: Training Vision-Language Models To Be Your Engaged Partners"☆14Updated 8 months ago
- [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning☆30Updated 2 years ago
- Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models☆44Updated 11 months ago
- The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".☆32Updated last year
- [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models☆44Updated last month
- ☆32Updated 4 months ago
- ☆13Updated 5 months ago
- Code for T-MARS data filtering☆35Updated last year
- MMSci: A Multimodal Multi-Discipline Dataset for PhD-Level Scientific Comprehension☆44Updated 6 months ago
- ☆16Updated 10 months ago
- Exploration of automated dataset selection approaches at large scales.☆41Updated 3 months ago
- Extending context length of visual language models☆11Updated 5 months ago
- VaLM: Visually-augmented Language Modeling. ICLR 2023.☆56Updated 2 years ago
- This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…☆23Updated 2 months ago
- Official Repository of LatentSeek☆30Updated last week
- ☆14Updated last year
- ☆29Updated 2 years ago
- Code for 'Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality', EMNLP 2022☆30Updated 2 years ago
- ☆10Updated 7 months ago
- ☆34Updated last year
- Vision Large Language Models trained on M3IT instruction tuning dataset☆17Updated last year
- Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.☆33Updated last year
- [TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"☆19Updated last year
- Visual and Embodied Concepts evaluation benchmark☆21Updated last year
- If CLIP Could Talk: Understanding Vision-Language Model Representations Through Their Preferred Concept Descriptions☆17Updated last year