Alternatives and similar repositories for Vary-toy:

Users that are interested in Vary-toy are comparing it to the libraries listed below

• Ucas-HaoranWei / Vary
  [ECCV 2024] Official code implementation of Vary: Scaling Up the Vision Vocabulary of Large Vision Language Models.
  ☆1,793Updated 2 weeks ago
• eric-ai-lab / MiniGPT-5
  Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"
  ☆858Updated last month
• LinkSoul-AI / Chinese-LLaVA
  支持中英文双语视觉-文本对话的开源可商用多模态模型。
  ☆360Updated last year
• dvlab-research / LLaMA-VID
  LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)
  ☆758Updated 5 months ago
• airaria / Visual-Chinese-LLaMA-Alpaca
  多模态中文LLaMA&Alpaca大语言模型（VisualCLA）
  ☆433Updated last year
• LingyvKong / OneChart
  [ACM'MM 2024 Oral] Official code for "OneChart: Purify the Chart Structural Extraction via One Auxiliary Token"
  ☆213Updated last month
• OpenBMB / VisCPM
  [ICLR'24 spotlight] Chinese and English Multimodal Large Model Series (Chat and Paint) | 基于CPM基础模型的中英双语多模态大模型系列
  ☆1,037Updated 7 months ago
• AIDC-AI / Ovis
  A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.
  ☆595Updated last month
• Vision-CAIR / MiniGPT4-video
  Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding
  ☆581Updated last month
• multimodal-art-projection / MAP-NEO
  ☆902Updated 6 months ago
• shikras / shikra
  ☆756Updated 6 months ago
• HIT-SCIR / Chinese-Mixtral-8x7B
  中文Mixtral-8x7B（Chinese-Mixtral-8x7B）
  ☆645Updated 5 months ago
• THUDM / CogVLM2
  GPT4V-level open-source multi-modal model based on Llama3-8B
  ☆2,204Updated 4 months ago
• lzw-lzw / GroundingGPT
  [ACL 2024] GroundingGPT: Language-Enhanced Multi-modal Grounding Model
  ☆314Updated 2 months ago
• opendatalab / WanJuan1.0
  万卷1.0多模态语料
  ☆555Updated last year
• InternLM / InternLM-XComposer
  InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
  ☆2,709Updated 3 weeks ago
• SkyworkAI / Vitron
  NeurIPS 2024 Paper: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editing
  ☆463Updated 2 months ago
• baaivision / Emu3
  Next-Token Prediction is All You Need
  ☆1,965Updated 2 months ago
• magic-research / bubogpt
  BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs
  ☆506Updated last year
• NExT-ChatV / NExT-Chat
  The code of the paper "NExT-Chat: An LMM for Chat, Detection and Segmentation".
  ☆230Updated 11 months ago
• CircleRadon / Osprey
  [CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"
  ☆769Updated 5 months ago
• zhangfaen / finetune-Qwen2-VL
  ☆281Updated 2 weeks ago
• Coobiw / MPP-LLaVA
  Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conv…
  ☆388Updated last month
• BAAI-DCAI / Bunny
  A family of lightweight multimodal models.
  ☆972Updated last month
• OpenGVLab / OmniCorpus
  OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text
  ☆302Updated 2 months ago
• phellonchen / X-LLM
  X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages
  ☆307Updated last year
• Yuliang-Liu / MultimodalOCR
  On the Hidden Mystery of OCR in Large Multimodal Models (OCRBench)
  ☆506Updated this week
• deepseek-ai / DeepSeek-VL2
  DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding
  ☆797Updated this week
• ucaslcl / Fox
  official code for "Fox: Focus Anywhere for Fine-grained Multi-page Document Understanding"
  ☆135Updated 7 months ago
• LDLINGLINGLING / adan_application
  一些大语言模型和多模态模型的应用,主要包括Rag，小模型，Agent，跨模态搜索，OCR等等
  ☆144Updated 2 months ago