Alternatives and similar repositories for SmolVLM-Finetune:

Users that are interested in SmolVLM-Finetune are comparing it to the libraries listed below

• mbzuai-oryx / PALO
  (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…
  ☆84Updated last month
• ByungKwanLee / TroL
  [EMNLP 2024] Official PyTorch implementation code for realizing the technical part of Traversal of Layers (TroL) presenting new propagati…
  ☆95Updated 9 months ago
• GaiZhenbiao / Phi3V-Finetuning
  Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.
  ☆58Updated 9 months ago
• 2U1 / Phi3-Vision-Finetune
  An open-source implementaion for fine-tuning Phi3-Vision and Phi3.5-Vision by Microsoft.
  ☆90Updated this week
• SHI-Labs / CuMo
  CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts
  ☆145Updated 9 months ago
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆98Updated 2 months ago
• SHI-Labs / OLA-VLM
  OLA-VLM: Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024
  ☆58Updated last month
• mfarre / Video-LLaVA-7B-hf-CinePile
  Video-LlaVA fine-tune for CinePile evaluation
  ☆51Updated 7 months ago
• XiaoduoAILab / XmodelVLM
  ☆68Updated 9 months ago
• iancovert / locality-alignment
  ☆44Updated 2 months ago
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆90Updated 3 months ago
• sayakpaul / simple-image-recaptioning
  Recaption large (Web)Datasets with vllm and save the artifacts.
  ☆49Updated 4 months ago
• google / imageinwords
  Data release for the ImageInWords (IIW) paper.
  ☆209Updated 4 months ago
• kongds / E5-V
  E5-V: Universal Embeddings with Multimodal Large Language Models
  ☆237Updated 3 months ago
• TempleX98 / MoVA
  [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context
  ☆149Updated 6 months ago
• luogen1996 / LLaVA-HR
  [ICLR2025] LLaVA-HR: High-Resolution Large Language-Vision Assistant
  ☆234Updated 7 months ago
• OpenGVLab / TPO
  Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment
  ☆45Updated 3 months ago
• damian0815 / finetune-clip-huggingface
  Finetuning CLIP on a small image/text dataset using huggingface libs
  ☆46Updated 2 years ago
• chenllliang / DnD-Transformer
  [ICLR 2025] Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegr…
  ☆69Updated 3 months ago
• PhyscalX / gradio-image-prompter
  Image Prompter for Gradio
  ☆85Updated last year
• DeepLearnXMU / AVG-LLaVA
  Code for "AVG-LLaVA: A Multimodal Large Model with Adaptive Visual Granularity"
  ☆26Updated 5 months ago
• NVlabs / LITA
  ☆169Updated 5 months ago
• WeihuangLin / INF-LLaVA
  INF-LLaVA: Dual-perspective Perception for High-Resolution Multimodal Large Language Model
  ☆42Updated 7 months ago
• 2U1 / Molmo-Finetune
  An open-source implementaion for fine-tuning Molmo-7B-D and Molmo-7B-O by allenai.
  ☆53Updated 2 months ago
• yihedeng9 / OpenVLThinker
  OpenVLThinker: An Early Exploration to Vision-Language Reasoning via Iterative Self-Improvement
  ☆50Updated this week
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆145Updated 2 months ago
• andimarafioti / florence2-finetuning
  Quick exploration into fine tuning florence 2
  ☆305Updated 6 months ago
• edgarGracia / gradio_image_annotator
  A Gradio component that can be used to annotate images with bounding boxes.
  ☆45Updated last month
• neulab / MultiUI
  Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding
  ☆50Updated 3 months ago
• UCSC-VLAA / Recap-DataComp-1B
  This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"
  ☆128Updated 9 months ago