Alternatives and similar repositories for mBLIP

Users that are interested in mBLIP are comparing it to the libraries listed below

• LAION-AI / General-GPT
  ☆65Updated 2 years ago
• mbzuai-oryx / PALO
  (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…
  ☆82Updated 2 months ago
• sanjayss34 / codevqa
  ☆84Updated 2 years ago
• wade3han / champagne
  An official codebase for paper " CHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos (ICCV 23)"
  ☆52Updated 2 years ago
• dhansmair / flamingo-mini
  Implementation of the deepmind Flamingo vision-language model, based on Hugging Face language models and ready for training
  ☆168Updated 2 years ago
• facebookresearch / diht
  Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training
  ☆138Updated 2 years ago
• prometheus-eval / prometheus-vision
  [ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specific…
  ☆77Updated last year
• huggingface / m4-logs
  M4 experiment logbook
  ☆58Updated 2 years ago
• htqin / GoogleBard-VisUnderstand
  How Good is Google Bard's Visual Understanding? An Empirical Study on Open Challenges
  ☆30Updated 2 years ago
• jeykigung / HiCLIP
  ☆30Updated 2 years ago
• RenShuhuai-Andy / TESTA
  [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
  ☆50Updated last year
• mshukor / ViCHA
  [BMVC22] Official Implementation of ViCHA: "Efficient Vision-Language Pretraining with Visual Concepts and Hierarchical Alignment"
  ☆55Updated 2 years ago
• NiteshMethani / PlotQA
  Dataset introduced in PlotQA: Reasoning over Scientific Plots
  ☆79Updated 2 years ago
• RotsteinNoam / FuseCap
  FuseCap: Leveraging Large Language Models for Enriched Fused Image Captions
  ☆55Updated last year
• allenai / grit_official
  Official repository for the General Robust Image Task (GRIT) Benchmark
  ☆54Updated 2 years ago
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆145Updated 3 weeks ago
• facebookresearch / selective-vqa_ood
  Implementation for the CVPR 2023 paper "Improving Selective Visual Question Answering by Learning from Your Peers" (https://arxiv.org/abs…
  ☆25Updated 2 years ago
• apple / ml-veclip
  The official repo for the paper "VeCLIP: Improving CLIP Training via Visual-enriched Captions"
  ☆246Updated 8 months ago
• kaiyuyue / nxtp
  PyTorch Implementation of Object Recognition as Next Token Prediction [CVPR'24 Highlight]
  ☆181Updated 5 months ago
• mlfoundations / VisIT-Bench
  ☆50Updated last year
• facebookresearch / CiT
  Code for the paper titled "CiT Curation in Training for Effective Vision-Language Data".
  ☆78Updated 2 years ago
• huggingface / docmatix
  A huge dataset for Document Visual Question Answering
  ☆20Updated last year
• umd-huang-lab / perceptionCLIP
  Code for our ICLR 2024 paper "PerceptionCLIP: Visual Classification by Inferring and Conditioning on Contexts"
  ☆79Updated last year
• SHI-Labs / CuMo
  CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts
  ☆154Updated last year
• XiaoduoAILab / XmodelVLM
  ☆70Updated last year
• MILVLG / imp
  a family of highly capabale yet efficient large multimodal models
  ☆191Updated last year
• eric-ai-lab / ComCLIP
  Official implementation and dataset for the NAACL 2024 paper "ComCLIP: Training-Free Compositional Image and Text Matching"
  ☆36Updated last year
• lucidrains / MaMMUT-pytorch
  Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch
  ☆103Updated last year
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆111Updated 8 months ago
• UCSC-VLAA / Recap-DataComp-1B
  [ICML 2025] This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"
  ☆142Updated last year