Alternatives and similar repositories for XmodelVLM

Users that are interested in XmodelVLM are comparing it to the libraries listed below

• SHI-Labs / OLA-VLM
  OLA-VLM: Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024
  ☆60Updated 4 months ago
• kkyuhun94 / dalda
  [ECCV'24 Workshops Oral] DALDA: Data Augmentation Leveraging Diffusion Model and LLM with Adaptive Guidance Scaling
  ☆31Updated 7 months ago
• top-yun / MS-PR
  Multi-vision Sensor Perception and Reasoning (MS-PR) benchmark, assessing VLMs on their capacity for sensor-specific reasoning.
  ☆16Updated 4 months ago
• NVlabs / STL
  Official Pytorch Implementation of Self-emerging Token Labeling
  ☆34Updated last year
• neulab / MultiUI
  Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding
  ☆51Updated 6 months ago
• WeihuangLin / INF-LLaVA
  INF-LLaVA: Dual-perspective Perception for High-Resolution Multimodal Large Language Model
  ☆42Updated 10 months ago
• yihedeng9 / OpenVLThinker
  OpenVLThinker: An Early Exploration to Vision-Language Reasoning via Iterative Self-Improvement
  ☆91Updated last month
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆93Updated 6 months ago
• tulip-berkeley / open_clip
  An open source implementation of CLIP (With TULIP Support)
  ☆157Updated last month
• sayakpaul / simple-image-recaptioning
  Recaption large (Web)Datasets with vllm and save the artifacts.
  ☆52Updated 7 months ago
• google-deepmind / tips
  ☆64Updated 2 months ago
• kaiyuyue / nxtp
  PyTorch Implementation of Object Recognition as Next Token Prediction [CVPR 2024 Highlight]
  ☆180Updated last month
• prometheus-eval / prometheus-vision
  [ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specific…
  ☆71Updated 9 months ago
• OpenGVLab / TPO
  Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment
  ☆51Updated 5 months ago
• EternityYW / Gemini-Commonsense-Evaluation
  Official implementation of "Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models"
  ☆36Updated last year
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆145Updated 2 months ago
• Hao840 / ADEM-VL
  PyTorch code for "ADEM-VL: Adaptive and Embedded Fusion for Efficient Vision-Language Tuning"
  ☆20Updated 7 months ago
• ByungKwanLee / TroL
  [EMNLP 2024] Official PyTorch implementation code for realizing the technical part of Traversal of Layers (TroL) presenting new propagati…
  ☆97Updated last year
• mbzuai-oryx / PALO
  (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…
  ☆84Updated 4 months ago
• iancovert / locality-alignment
  ☆50Updated 5 months ago
• umd-huang-lab / perceptionCLIP
  Code for our ICLR 2024 paper "PerceptionCLIP: Visual Classification by Inferring and Conditioning on Contexts"
  ☆77Updated last year
• jihaonew / MM-Instruct
  MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment
  ☆35Updated 11 months ago
• UX-Decoder / FIND
  [NeurIPS 2024] Official implementation of the paper "Interfacing Foundation Models' Embeddings"
  ☆125Updated 10 months ago
• FudanNLPLAB / MouSi
  ☆73Updated last year
• sunsmarterjie / ChatterBox
  [AAAI2025] ChatterBox: Multi-round Multimodal Referring and Grounding, Multimodal, Multi-round dialogues
  ☆55Updated last month
• togethercomputer / Dragonfly
  ☆75Updated 8 months ago
• NVlabs / LITA
  ☆179Updated 8 months ago
• apple / ml-tic-clip
  Repository for the paper: "TiC-CLIP: Continual Training of CLIP Models".
  ☆102Updated last year
• ylingfeng / Add-SD
  Official implementation of Add-SD: Rational Generation without Manual Reference.
  ☆27Updated 10 months ago
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆110Updated 5 months ago