Alternatives and similar repositories for Ovis:

Users that are interested in Ovis are comparing it to the libraries listed below

• baaivision / Emu3
  Next-Token Prediction is All You Need
  ☆2,076Updated 3 weeks ago
• zhangfaen / finetune-Qwen2-VL
  ☆349Updated 2 months ago
• EvolvingLMMs-Lab / open-r1-multimodal
  A fork to add multimodal model training to open-r1
  ☆1,181Updated 2 months ago
• MoonshotAI / Kimi-VL
  Kimi-VL: Mixture-of-Experts Vision-Language Model for Multimodal Reasoning, Long-Context Understanding, and Strong Agent Capabilities
  ☆685Updated this week
• turningpoint-ai / VisualThinker-R1-Zero
  Explore the Multimodal “Aha Moment” on 2B Model
  ☆561Updated 3 weeks ago
• Fancy-MLLM / R1-Onevision
  R1-onevision, a visual language model capable of deep CoT reasoning.
  ☆489Updated this week
• THUDM / CogVLM2
  GPT4V-level open-source multi-modal model based on Llama3-8B
  ☆2,332Updated last month
• hiyouga / EasyR1
  EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL
  ☆1,968Updated this week
• Liuziyu77 / Visual-RFT
  Official repository of ’Visual-RFT: Visual Reinforcement Fine-Tuning’
  ☆1,542Updated 3 weeks ago
• GAIR-NLP / anole
  Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation
  ☆744Updated 8 months ago
• open-compass / VLMEvalKit
  Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
  ☆2,197Updated this week
• DAMO-NLP-SG / VideoLLaMA3
  Frontier Multimodal Foundation Models for Image and Video Understanding
  ☆723Updated last week
• Osilly / Vision-R1
  This is the first paper to explore how to effectively use RL for MLLMs and introduce Vision-R1, a reasoning MLLM that leverages cold-sta…
  ☆478Updated this week
• thunlp / LLaVA-UHD
  LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformer
  ☆371Updated 2 weeks ago
• Vision-CAIR / MiniGPT4-video
  Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding
  ☆612Updated 4 months ago
• ModalMinds / MM-EUREKA
  MM-EUREKA: Exploring Visual Aha Moment with Rule-based Large-scale Reinforcement Learning
  ☆518Updated this week
• mbzuai-oryx / LLaVA-pp
  🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)
  ☆836Updated 9 months ago
• PKU-YuanGroup / LLaVA-CoT
  LLaVA-CoT, a visual language model capable of spontaneous, systematic reasoning
  ☆1,943Updated this week
• HumanMLLM / R1-Omni
  ☆818Updated 3 weeks ago
• microsoft / LLM2CLIP
  LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.
  ☆505Updated 3 weeks ago
• Vision-CAIR / LongVU
  ☆368Updated last month
• bytedance / tarsier
  Tarsier -- a family of large-scale video-language models, which is designed to generate high-quality video descriptions , together with g…
  ☆349Updated 3 weeks ago
• LLaVA-VL / LLaVA-NeXT
  ☆3,686Updated last month
• Deep-Agent / R1-V
  Witness the aha moment of VLM with less than $3.
  ☆3,522Updated last month
• zjysteven / lmms-finetune
  A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision,…
  ☆284Updated last month
• tulerfeng / Video-R1
  Video-R1: Reinforcing Video Reasoning in MLLMs [🔥the first paper to explore R1 for video]
  ☆391Updated this week
• InternLM / InternLM-XComposer
  InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
  ☆2,808Updated 2 months ago
• rhymes-ai / Aria
  Codebase for Aria - an Open Multimodal Native MoE
  ☆1,030Updated 2 months ago
• SimpleBerry / LLaMA-O1
  Large Reasoning Models
  ☆800Updated 4 months ago
• AILab-CVC / SEED-X
  Multimodal Models in Real World
  ☆482Updated last month