Alternatives and similar repositories for XmodelVLM

Users that are interested in XmodelVLM are comparing it to the libraries listed below

• SHI-Labs / OLA-VLM
  OLA-VLM: Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024
  ☆59Updated 3 months ago
• yihedeng9 / OpenVLThinker
  OpenVLThinker: An Early Exploration to Vision-Language Reasoning via Iterative Self-Improvement
  ☆88Updated 2 weeks ago
• OpenGVLab / TPO
  Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment
  ☆51Updated 5 months ago
• google-deepmind / tips
  ☆51Updated last month
• yfzhang114 / SliME
  ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models
  ☆159Updated 5 months ago
• tulip-berkeley / open_clip
  An open source implementation of CLIP (With TULIP Support)
  ☆147Updated 3 weeks ago
• mbzuai-oryx / PALO
  (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…
  ☆83Updated 3 months ago
• poloclub / ClickDiffusion
  ClickDiffusion: Harnessing LLMs for Interactive Precise Image Editing
  ☆69Updated last year
• NVlabs / STL
  Official Pytorch Implementation of Self-emerging Token Labeling
  ☆33Updated last year
• umd-huang-lab / perceptionCLIP
  Code for our ICLR 2024 paper "PerceptionCLIP: Visual Classification by Inferring and Conditioning on Contexts"
  ☆77Updated last year
• ByungKwanLee / TroL
  [EMNLP 2024] Official PyTorch implementation code for realizing the technical part of Traversal of Layers (TroL) presenting new propagati…
  ☆97Updated 11 months ago
• WeihuangLin / INF-LLaVA
  INF-LLaVA: Dual-perspective Perception for High-Resolution Multimodal Large Language Model
  ☆42Updated 10 months ago
• UX-Decoder / FIND
  [NeurIPS 2024] Official implementation of the paper "Interfacing Foundation Models' Embeddings"
  ☆124Updated 9 months ago
• ylingfeng / Add-SD
  Official implementation of Add-SD: Rational Generation without Manual Reference.
  ☆27Updated 9 months ago
• prometheus-eval / prometheus-vision
  [ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specific…
  ☆71Updated 8 months ago
• kkyuhun94 / dalda
  [ECCV'24 Workshops Oral] DALDA: Data Augmentation Leveraging Diffusion Model and LLM with Adaptive Guidance Scaling
  ☆31Updated 7 months ago
• sunsmarterjie / ChatterBox
  [AAAI2025] ChatterBox: Multi-round Multimodal Referring and Grounding, Multimodal, Multi-round dialogues
  ☆55Updated last month
• wjbmattingly / qwen2-vl-finetune-huggingface
  This project is a collection of fine-tuning scripts to help researchers fine-tune Qwen 2 VL on HuggingFace datasets.
  ☆69Updated 8 months ago
• jihaonew / MM-Instruct
  MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment
  ☆34Updated 11 months ago
• google / imageinwords
  Data release for the ImageInWords (IIW) paper.
  ☆211Updated 6 months ago
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆107Updated 4 months ago
• kaiyuyue / nxtp
  Object Recognition as Next Token Prediction (CVPR 2024 Highlight)
  ☆178Updated last month
• NVlabs / LITA
  ☆177Updated 7 months ago
• dongyh20 / Insight-V
  [CVPR2025 Highlight] Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models
  ☆195Updated 2 months ago
• neulab / MultiUI
  Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding
  ☆51Updated 5 months ago
• gregor-ge / mBLIP
  ☆87Updated last year
• nttmdlab-nlp / InstructDoc
  InstructDoc: A Dataset for Zero-Shot Generalization of Visual Document Understanding with Instructions (AAAI2024)
  ☆160Updated last year
• htqin / GoogleBard-VisUnderstand
  How Good is Google Bard's Visual Understanding? An Empirical Study on Open Challenges
  ☆30Updated last year
• iancovert / locality-alignment
  ☆50Updated 4 months ago
• TempleX98 / MoVA
  [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context
  ☆156Updated 8 months ago