VITA-MLLM / VITA

Related projects: ⓘ

• DAMO-NLP-SG / VideoLLaMA2
  VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs
  ☆719Updated this week
• QwenLM / Qwen2-Audio
  The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.
  ☆1,069Updated last month
• Vision-CAIR / MiniGPT4-video
  Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding
  ☆535Updated last month
• dvlab-research / LLaMA-VID
  LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)
  ☆688Updated last month
• BradyFU / Video-MME
  ✨✨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis
  ☆365Updated 3 months ago
• open-compass / VLMEvalKit
  Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 40+ benchmarks
  ☆1,018Updated this week
• BAAI-DCAI / Bunny
  A family of lightweight multimodal models.
  ☆877Updated 2 weeks ago
• PKU-YuanGroup / LanguageBind
  【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment
  ☆682Updated 5 months ago
• OpenMOSS / AnyGPT
  Code for "AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling"
  ☆742Updated 3 weeks ago
• eric-ai-lab / MiniGPT-5
  Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"
  ☆842Updated 6 months ago
• BradyFU / Woodpecker
  ✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models. The first work to correct hallucinations in MLLMs.
  ☆593Updated 3 months ago
• QwenLM / Qwen2-VL
  Qwen2-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.
  ☆1,904Updated this week
• Ucas-HaoranWei / Vary-toy
  Official code implementation of Vary-toy (Small Language Model Meets with Reinforced Vision Vocabulary)
  ☆587Updated 2 weeks ago
• TinyLLaVA / TinyLLaVA_Factory
  A Framework of Small-scale Large Multimodal Models
  ☆568Updated last week
• GAIR-NLP / anole
  Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation
  ☆644Updated last month
• mbzuai-oryx / LLaVA-pp
  🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)
  ☆794Updated 2 months ago
• InternLM / InternLM-XComposer
  InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output
  ☆2,449Updated 2 weeks ago
• Meituan-AutoML / MobileVLM
  Strong and Open Vision Language Assistant for Mobile Devices
  ☆971Updated 5 months ago
• csuhan / OneLLM
  [CVPR 2024] OneLLM: One Framework to Align All Modalities with Language
  ☆553Updated this week
• QwenLM / Qwen-Audio
  The official repo of Qwen-Audio (通义千问-Audio) chat & pretrained large audio language model proposed by Alibaba Cloud.
  ☆1,390Updated 2 months ago
• magic-research / PLLaVA
  Official repository for the paper PLLaVA
  ☆551Updated last month
• THUDM / CogVLM2
  GPT4V-level open-source multi-modal model based on Llama3-8B
  ☆1,976Updated 2 weeks ago
• LetheSec / HuggingFace-Download-Accelerator
  利用HuggingFace的官方下载工具从镜像网站进行高速下载。
  ☆738Updated 2 weeks ago
• showlab / Show-o
  Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.
  ☆797Updated this week
• lzw-lzw / GroundingGPT
  [ACL 2024] GroundingGPT: Language-Enhanced Multi-modal Grounding Model
  ☆283Updated last month
• jun0wanan / awesome-large-multimodal-agents
  ☆294Updated 3 months ago
• Vchitect / Latte
  Latte: Latent Diffusion Transformer for Video Generation.
  ☆1,637Updated last week
• LinkSoul-AI / LLaSM
  第一个支持中英文双语语音-文本多模态对话的开源可商用对话模型。便捷的语音输入将大幅改善以文本为输入的大模型的使用体验，同时避免了基于 ASR 解决方案的繁琐流程以及可能引入的错误。
  ☆519Updated last year
• SkyworkAI / Vitron
  A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editing
  ☆282Updated 2 months ago
• NUS-HPC-AI-Lab / VideoSys
  VideoSys: An easy and efficient system for video generation
  ☆1,633Updated this week