Alternatives and similar repositories for vlm

Users that are interested in vlm are comparing it to the libraries listed below

• capjamesg / sam-clip
  Use Grounding DINO, Segment Anything, and CLIP to label objects in images.
  ☆31Updated last year
• mingyin0312 / RL4LLM
  RL significantly the reasoning capability of Qwen2.5-1.5B-Instruct
  ☆29Updated 3 months ago
• adithya-s-k / YoloGemma
  Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…
  ☆80Updated last year
• ariG23498 / quantized-diffusion-inference
  Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs
  ☆38Updated 7 months ago
• bhimrazy / chat-with-qwen2-vl
  Chat with Qwen2-VL. Qwen2-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.
  ☆10Updated 8 months ago
• mrmaheshrajput / productionizing-llms
  Code Repository for Blog - How to Productionize Large Language Models (LLMs)
  ☆11Updated last year
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆92Updated 5 months ago
• GaiZhenbiao / Phi3V-Finetuning
  Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.
  ☆58Updated 11 months ago
• Sayandip170900 / CUDA-Challenge
  100 Days of GPU Challenge
  ☆20Updated this week
• ali-bahrainian / RAG_best_practices
  ☆92Updated 2 months ago
• ashishpatel26 / ai-tutor-rag-system
  This is a repository for the course "From Beginner to LLM Developer" by Towards AI.
  ☆11Updated 5 months ago
• bhimrazy / chat-with-phi-3-vision
  Chat with Phi 3.5/3 Vision LLMs. Phi-3.5-vision is a lightweight, state-of-the-art open multimodal model built upon datasets which includ…
  ☆33Updated 5 months ago
• nadsoft-opensource / RAG-with-open-source-multi-modal
  ☆19Updated last year
• ariG23498 / gemma3-object-detection
  Fine tune Gemma 3 on an object detection task
  ☆43Updated this week
• wjbmattingly / qwen2-vl-finetune-huggingface
  This project is a collection of fine-tuning scripts to help researchers fine-tune Qwen 2 VL on HuggingFace datasets.
  ☆69Updated 8 months ago
• Delve-ERAV1 / Phi-2-Vision-Language
  Pretraining and finetuning for visual instruction following with Mixture of Experts
  ☆15Updated last year
• akashAD98 / Multilingual-RAG
  multilingual RAG
  ☆16Updated last year
• Abinesh-Mathivanan / building-llm-from-scratch
  built a 124M param GPT
  ☆20Updated 4 months ago
• mbzuai-oryx / PALO
  (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…
  ☆83Updated 3 months ago
• FareedKhan-dev / train-llama4
  Building LLaMA 4 MoE from Scratch
  ☆50Updated last month
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 10 months ago
• qnguyen3 / nanoLLaVA
  World's Smallest Vision-Language Model
  ☆27Updated last year
• ThinamXx / cuda-mode
  Making of cuda kernel
  ☆16Updated last week
• aniketmaurya / Agents
  Build Agentic workflows with function calling using open LLMs
  ☆26Updated this week
• MontrealAI / AGI-Agent-v0
  A minimal yet unstoppable blueprint for multi-agent AI—anchored by the rare, far-reaching “Multi-Agent AI DAO” (2017 Prior Art)—empowerin…
  ☆27Updated 4 months ago
• uygarkurt / Fine-Tune-VLMs
  ☆14Updated 4 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• antar-ai / yolo-examples
  This Repository demostrates various examples using YOLO
  ☆13Updated last year
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆34Updated 3 weeks ago