Alternatives and similar repositories for Mirasol:

Users that are interested in Mirasol are comparing it to the libraries listed below

• MCR-PEFT / Ex-MCR
  ☆41Updated last year
• ByungKwanLee / Phantom
  [Under Review] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with enla…
  ☆49Updated 4 months ago
• RenShuhuai-Andy / TESTA
  [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
  ☆49Updated last year
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆12Updated 7 months ago
• zjunlp / Deco
  [ICLR 2025] MLLM can see? Dynamic Correction Decoding for Hallucination Mitigation
  ☆34Updated 2 months ago
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆40Updated 3 weeks ago
• kyegomez / MC-ViT
  Implementation of the model: "(MC-ViT)" from the paper: "Memory Consolidation Enables Long-Context Video Understanding"
  ☆20Updated 3 weeks ago
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆44Updated last month
• yangbang18 / ZeroNLG
  (TPAMI'2024) ZeroNLG: Aligning and Autoencoding Domains for Zero-Shot Multimodal and Multilingual Natural Language Generation
  ☆20Updated 6 months ago
• showlab / VisInContext
  Official implementation of Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learning
  ☆14Updated 3 months ago
• lscpku / VITATECS
  ☆17Updated 7 months ago
• locuslab / llava-token-compression
  ☆38Updated 3 months ago
• IDEA-FinAI / RagVL
  Official PyTorch Implementation of MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced …
  ☆57Updated 3 months ago
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆37Updated 3 months ago
• om-ai-lab / ZoomEye
  ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Exploration
  ☆23Updated last month
• 360CVGroup / Inner-Adaptor-Architecture
  LMM solved catastrophic forgetting, AAAI2025
  ☆38Updated 3 months ago
• kyegomez / qformer
  Implementation of Qformer from BLIP2 in Zeta Lego blocks.
  ☆35Updated 3 months ago
• Optimization-AI / fast_clip
  ☆22Updated 4 months ago
• kkahatapitiya / LangRepo
  Language Repository for Long Video Understanding
  ☆31Updated 8 months ago
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆101Updated 2 weeks ago
• layer6ai-labs / fusemix
  Data-Efficient Multimodal Fusion on a Single GPU
  ☆52Updated 9 months ago
• multimodal-art-projection / OmniBench
  A project for tri-modal LLM benchmarking and instruction tuning.
  ☆23Updated last week
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆59Updated 7 months ago
• mlfoundations / VisIT-Bench
  ☆47Updated last year
• UCSC-VLAA / Sight-Beyond-Text
  [TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
  ☆19Updated last year
• kyegomez / LIMoE
  Implementation of the "the first large-scale multimodal mixture of experts models." from the paper: "Multimodal Contrastive Learning with…
  ☆25Updated 3 weeks ago
• BriansIDP / AudioVisualLLM
  ☆17Updated 9 months ago
• MIO-Team / MIO
  MIO: A Foundation Model on Multimodal Tokens
  ☆21Updated 2 months ago
• kyegomez / PaLM2-VAdapter
  Implementation of "PaLM2-VAdapter:" from the multi-modal model paper: "PaLM2-VAdapter: Progressively Aligned Language Model Makes a Stron…
  ☆17Updated 3 months ago