AIDC-AI / Ovis
A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.
☆660Updated this week
Alternatives and similar repositories for Ovis:
Users that are interested in Ovis are comparing it to the libraries listed below
- Next-Token Prediction is All You Need☆2,004Updated 3 months ago
- A family of lightweight multimodal models.☆987Updated 3 months ago
- Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation☆721Updated 6 months ago
- ☆320Updated last week
- Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding☆588Updated 2 months ago
- LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.☆470Updated last month
- Official repository for the paper PLLaVA☆638Updated 6 months ago
- Long Context Transfer from Language to Vision☆360Updated 3 months ago
- Tarsier -- a family of large-scale video-language models, which is designed to generate high-quality video descriptions , together with g…☆284Updated this week
- 🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)☆830Updated 7 months ago
- ☆351Updated 3 months ago
- ✨✨VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction☆2,093Updated last week
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Feature Pyramid via Hierarchical Window Transformer☆366Updated last month
- ✨✨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis☆461Updated 2 months ago
- VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs☆1,078Updated 3 weeks ago
- NeurIPS 2024 Paper: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editing☆484Updated 4 months ago
- InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions☆2,755Updated 3 weeks ago
- Multimodal Models in Real World☆437Updated 3 months ago
- LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)☆768Updated 6 months ago
- GPT4V-level open-source multi-modal model based on Llama3-8B☆2,262Updated 5 months ago
- ☆426Updated 2 months ago
- 🔥🔥First-ever hour scale video understanding models☆234Updated last month
- Valley is a cutting-edge multimodal large model designed to handle a variety of tasks involving text, images, and video data.☆214Updated last week
- Codebase for Aria - an Open Multimodal Native MoE☆998Updated 3 weeks ago
- A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision,…☆246Updated 2 weeks ago
- Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊☆263Updated 3 weeks ago
- Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation☆1,576Updated 6 months ago