Alternatives and similar repositories for Baichuan-Omni-1.5:

Users that are interested in Baichuan-Omni-1.5 are comparing it to the libraries listed below

• westlake-baichuan-mllm / bc-omni
  Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊
  ☆265Updated 2 months ago
• VITA-MLLM / Freeze-Omni
  ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM
  ☆297Updated 2 months ago
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆368Updated last week
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆200Updated 2 months ago
• LengSicong / MMR1
  MMR1: Advancing the Frontiers of Multimodal Reasoning
  ☆145Updated last week
• infinigence / Infini-Megrez-Omni
  ☆218Updated last month
• 0nutation / SpeechAgents
  SpeechAgents: Human-Communication Simulation with Multi-Modal Multi-Agent Systems
  ☆81Updated last year
• OpenBMB / UltraEval-Audio
  An easy-to-use, fast, and easily integrable tool for evaluating audio LLM
  ☆69Updated this week
• baichuan-inc / Baichuan-Audio
  Baichuan-Audio: A Unified Framework for End-to-End Speech Interaction
  ☆163Updated last month
• invictus717 / MiCo
  Explore the Limits of Omni-modal Pretraining at Scale
  ☆97Updated 6 months ago
• bytedance / Valley
  Valley is a cutting-edge multimodal large model designed to handle a variety of tasks involving text, images, and video data.
  ☆224Updated last month
• DAMO-NLP-SG / multimodal_textbook
  The official repository for "2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining"
  ☆148Updated last week
• FudanNLPLAB / MouSi
  ☆73Updated last year
• wntg / LLaMA-Omni
  llama-omni训练代码复现
  ☆57Updated 2 months ago
• VectorSpaceLab / Video-XL
  🔥🔥First-ever hour scale video understanding models
  ☆259Updated this week
• turningpoint-ai / VisualThinker-R1-Zero
  Explore the Multimodal “Aha Moment” on 2B Model
  ☆524Updated last week
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆96Updated last month
• sterzhang / image-textualization
  Image Textualization: An Automatic Framework for Generating Rich and Detailed Image Descriptions (NeurIPS 2024)
  ☆158Updated 7 months ago
• thunlp / Migician
  Migician: Revealing the Magic of Free-Form Multi-Image Grounding in Multimodal Large Language Models
  ☆47Updated 2 months ago
• WePOINTS / WePOINTS
  ☆172Updated last month
• RLHF-V / RLAIF-V
  [CVPR'25] RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthiness
  ☆326Updated 3 weeks ago
• bigai-nlco / TokenSwift
  From Hours to Minutes: Lossless Acceleration of Ultra Long Sequence Generation
  ☆80Updated last week
• MBZUAI-LLM / web2code
  Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs
  ☆75Updated 5 months ago
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆145Updated this week
• RainBowLuoCS / OpenOmni
  OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Rea…
  ☆40Updated last week
• krystalan / DRT
  DRT-o1: Optimized Deep Reasoning Translation via Long Chain-of-Thought
  ☆211Updated 2 months ago
• ZhangXJ199 / TinyLLaVA-Video
  A Simple Framework of Small-scale Large Multimodal Models for Video Understanding Based on TinyLLaVA_Factory.
  ☆46Updated last week
• Tencent / llm.hunyuan.T1
  ☆60Updated last week
• HumanMLLM / HumanOmni
  HumanOmni
  ☆129Updated 2 weeks ago
• cnzzx / VSA
  Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines
  ☆117Updated 4 months ago