Alternatives and similar repositories for Vary-toy

Users that are interested in Vary-toy are comparing it to the libraries listed below

• Ucas-HaoranWei / Vary
  [ECCV 2024] Official code implementation of Vary: Scaling Up the Vision Vocabulary of Large Vision Language Models.
  ☆1,834Updated 5 months ago
• LinkSoul-AI / Chinese-LLaVA
  支持中英文双语视觉-文本对话的开源可商用多模态模型。
  ☆370Updated last year
• eric-ai-lab / MiniGPT-5
  Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"
  ☆860Updated 3 weeks ago
• dvlab-research / LLaMA-VID
  LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)
  ☆809Updated 10 months ago
• shikras / shikra
  ☆778Updated 10 months ago
• OpenBMB / VisCPM
  [ICLR'24 spotlight] Chinese and English Multimodal Large Model Series (Chat and Paint) | 基于CPM基础模型的中英双语多模态大模型系列
  ☆1,056Updated 11 months ago
• airaria / Visual-Chinese-LLaMA-Alpaca
  多模态中文LLaMA&Alpaca大语言模型（VisualCLA）
  ☆447Updated last year
• magic-research / bubogpt
  BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs
  ☆509Updated last year
• LingyvKong / OneChart
  [ACM'MM 2024 Oral] Official code for "OneChart: Purify the Chart Structural Extraction via One Auxiliary Token"
  ☆223Updated last month
• BAAI-DCAI / Bunny
  A family of lightweight multimodal models.
  ☆1,018Updated 6 months ago
• NExT-ChatV / NExT-Chat
  The code of the paper "NExT-Chat: An LMM for Chat, Detection and Segmentation".
  ☆244Updated last year
• lzw-lzw / GroundingGPT
  [ACL 2024] GroundingGPT: Language-Enhanced Multi-modal Grounding Model
  ☆331Updated 6 months ago
• baaivision / tokenize-anything
  [ECCV 2024] Tokenize Anything via Prompting
  ☆582Updated 5 months ago
• FlagAI-Open / Aquila2
  The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.
  ☆441Updated 7 months ago
• Vision-CAIR / MiniGPT4-video
  Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding
  ☆619Updated 5 months ago
• mbzuai-oryx / LLaVA-pp
  🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)
  ☆835Updated 10 months ago
• Yuliang-Liu / MultimodalOCR
  On the Hidden Mystery of OCR in Large Multimodal Models (OCRBench)
  ☆623Updated 3 months ago
• baaivision / Emu
  Emu Series: Generative Multimodal Models from BAAI
  ☆1,723Updated 8 months ago
• OpenGVLab / OmniCorpus
  [ICLR 2025 Spotlight] OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text
  ☆356Updated 3 weeks ago
• Yuliang-Liu / Monkey
  【CVPR 2024 Highlight】Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models
  ☆1,759Updated last month
• large-ocr-model / large-ocr-model.github.io
  ☆179Updated last year
• CircleRadon / Osprey
  [CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"
  ☆819Updated last month
• ucaslcl / Fox
  official code for "Fox: Focus Anywhere for Fine-grained Multi-page Document Understanding"
  ☆149Updated last year
• baaivision / Emu3
  Next-Token Prediction is All You Need
  ☆2,134Updated 2 months ago
• Coobiw / MPP-LLaVA
  Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conv…
  ☆448Updated 2 months ago
• phellonchen / X-LLM
  X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages
  ☆310Updated last year
• AIDC-AI / Ovis
  A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.
  ☆923Updated 2 months ago
• alipay / Ant-Multi-Modal-Framework
  Research Code for Multimodal-Cognition Team in Ant Group
  ☆146Updated last week
• SkyworkAI / Vitron
  NeurIPS 2024 Paper: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editing
  ☆541Updated 7 months ago
• LLaVA-VL / LLaVA-Plus-Codebase
  LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
  ☆743Updated last year