Alternatives and similar repositories for vl-merging:

Users that are interested in vl-merging are comparing it to the libraries listed below

• psunlpgroup / VisOnlyQA
  This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…
  ☆20Updated last month
• shizhediao / DaVinci
  Source code for the paper "Prefix Language Models are Unified Modal Learners"
  ☆43Updated last year
• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆32Updated last year
• BaohaoLiao / mefts
  [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  ☆29Updated last year
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆47Updated 2 months ago
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆75Updated 3 months ago
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆32Updated last year
• wzq016 / PINE
  Offcial Repo of Paper "Eliminating Position Bias of Language Models: A Mechanistic Approach""
  ☆11Updated 4 months ago
• google / spiqa
  Code release for "SPIQA: A Dataset for Multimodal Question Answering on Scientific Papers" [NeurIPS D&B, 2024]
  ☆48Updated this week
• maszhongming / ParaKnowTransfer
  Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"
  ☆31Updated 8 months ago
• yegcjs / DiffusionLLM
  Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"
  ☆65Updated 11 months ago
• UCSC-VLAA / Sight-Beyond-Text
  [TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
  ☆19Updated last year
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆41Updated this week
• yale-nlp / refdpo
  ☆15Updated 5 months ago
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆34Updated 9 months ago
• Leezekun / MMSci
  MMSci: A Multimodal Multi-Discipline Dataset for PhD-Level Scientific Comprehension
  ☆35Updated last month
• jihoontack / MAC
  Online Adaptation of Language Models with a Memory of Amortized Contexts (NeurIPS 2024)
  ☆59Updated 5 months ago
• princeton-nlp / PTP
  Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073
  ☆26Updated 6 months ago
• Wang-ML-Lab / multimodal-needle-in-a-haystack
  Code and data for the benchmark "Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Lan…
  ☆36Updated 6 months ago
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆38Updated 2 months ago
• HYPJUDY / Sparkles
  Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models
  ☆43Updated 7 months ago
• WildVision-AI / LMM-Engines
  ☆15Updated 2 months ago
• TobiasLee / VEC
  Visual and Embodied Concepts evaluation benchmark
  ☆21Updated last year
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆46Updated last year
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆41Updated 5 months ago
• chenllliang / MMEvalPro
  Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs
  ☆22Updated 3 months ago
• ctlllll / reward_collapse
  ☆26Updated last year
• mukhal / grace
  [EMNLP 2023, Findings] GRACE: Discriminator-Guided Chain-of-Thought Reasoning
  ☆46Updated 3 months ago
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated last year
• lqtrung1998 / mwp_cot_design
  ☆13Updated last year