Alternatives and similar repositories for SmolVLM-Finetune

Users that are interested in SmolVLM-Finetune are comparing it to the libraries listed below

• SHI-Labs / OLA-VLM
  OLA-VLM: Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024
  ☆60Updated 3 months ago
• yihedeng9 / OpenVLThinker
  OpenVLThinker: An Early Exploration to Vision-Language Reasoning via Iterative Self-Improvement
  ☆89Updated 2 weeks ago
• OpenGVLab / TPO
  Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment
  ☆51Updated 5 months ago
• 2U1 / Molmo-Finetune
  An open-source implementaion for fine-tuning Molmo-7B-D and Molmo-7B-O by allenai.
  ☆55Updated last month
• iancovert / locality-alignment
  ☆50Updated 4 months ago
• Hon-Wong / ByteVideoLLM
  This is the official repo for ByteVideoLLM/Dynamic-VLM
  ☆20Updated 5 months ago
• AFeng-x / Draw-and-Understand
  [ICLR2025] Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want
  ☆76Updated 4 months ago
• XiaoduoAILab / XmodelVLM
  ☆68Updated 11 months ago
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆57Updated last month
• alibaba / conv-llava
  ☆115Updated 10 months ago
• TempleX98 / MoVA
  [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context
  ☆156Updated 8 months ago
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆108Updated 4 months ago
• ByungKwanLee / Meteor
  [NeurIPS 2024] Official PyTorch implementation code for realizing the technical part of Mamba-based traversal of rationale (Meteor) to im…
  ☆114Updated last year
• SHI-Labs / CuMo
  CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts
  ☆149Updated 11 months ago
• cnzzx / VSA
  Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines
  ☆125Updated 7 months ago
• ByungKwanLee / Phantom
  [Under Review] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with enla…
  ☆60Updated 7 months ago
• XMUDeepLIT / AVG-LLaVA
  Code for "AVG-LLaVA: A Multimodal Large Model with Adaptive Visual Granularity"
  ☆28Updated 7 months ago
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆165Updated 7 months ago
• google-research / silc
  [ECCV 2024] Official Release of SILC: Improving vision language pretraining with self-distillation
  ☆44Updated 8 months ago
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆141Updated 6 months ago
• foundation-multimodal-models / CAPTURE
  ☆60Updated 10 months ago
• TIGER-AI-Lab / Pixel-Reasoner
  Pixel-Level Reasoning Model trained with RL
  ☆92Updated this week
• dongyh20 / Insight-V
  [CVPR2025 Highlight] Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models
  ☆195Updated 2 months ago
• si0wang / ThinkLite-VL
  ☆80Updated last month
• tulip-berkeley / open_clip
  An open source implementation of CLIP (With TULIP Support)
  ☆152Updated 3 weeks ago
• see-say-segment / sesame
  🔥 [CVPR 2024] Official implementation of "See, Say, and Segment: Teaching LMMs to Overcome False Premises (SESAME)"
  ☆40Updated 11 months ago
• ByungKwanLee / TroL
  [EMNLP 2024] Official PyTorch implementation code for realizing the technical part of Traversal of Layers (TroL) presenting new propagati…
  ☆97Updated 11 months ago
• SCZwangxiao / video-FlexReduc
  Official implementation of paper AdaReTaKe: Adaptive Redundancy Reduction to Perceive Longer for Video-language Understanding
  ☆62Updated last month
• opendatalab / CLIP-Parrot-Bias
  ECCV2024_Parrot Captions Teach CLIP to Spot Text
  ☆66Updated 9 months ago
• UMass-Embodied-AGI / FlexAttention
  Official implementation for FlexAttention for Efficient High-Resolution Vision-Language Models
  ☆40Updated 4 months ago