mbzuai-oryx / LlamaV-o1
Rethinking Step-by-step Visual Reasoning in LLMs
☆220Updated this week
Alternatives and similar repositories for LlamaV-o1:
Users that are interested in LlamaV-o1 are comparing it to the libraries listed below
- LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture☆188Updated 3 weeks ago
- Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models☆127Updated last month
- ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models☆147Updated last month
- E5-V: Universal Embeddings with Multimodal Large Language Models☆224Updated last month
- LLaVA-HR: High-Resolution Large Language-Vision Assistant☆223Updated 5 months ago
- This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"☆128Updated 7 months ago
- Code for ChatRex: Taming Multimodal LLM for Joint Perception and Understanding☆126Updated this week
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆308Updated 6 months ago
- [NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models☆268Updated 3 months ago
- The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss". A su…☆220Updated 2 weeks ago
- CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts☆138Updated 7 months ago
- [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"☆128Updated 2 months ago
- The official repository for "2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining"☆132Updated last week
- Long Context Transfer from Language to Vision☆359Updated 2 months ago
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Feature Pyramid via Hierarchical Window Transformer☆354Updated 2 weeks ago
- Official implementation of the Law of Vision Representation in MLLMs☆148Updated 2 months ago
- LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.☆452Updated last week
- [CVPR 2024] Official implementation of "ViTamin: Designing Scalable Vision Models in the Vision-language Era"☆196Updated 7 months ago
- [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation☆212Updated last week
- Official repository for paper MG-LLaVA: Towards Multi-Granularity Visual Instruction Tuning(https://arxiv.org/abs/2406.17770).☆152Updated 4 months ago
- [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context☆144Updated 4 months ago
- a family of highly capabale yet efficient large multimodal models☆176Updated 5 months ago
- Official code for Paper "Mantis: Multi-Image Instruction Tuning" (TMLR2024)☆196Updated this week
- SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models☆198Updated 4 months ago
- Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs☆72Updated 3 months ago
- 📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.☆343Updated last week
- [CVPR 2024] VCoder: Versatile Vision Encoders for Multimodal Large Language Models☆271Updated 9 months ago
- ☆109Updated 6 months ago
- [NeurIPS 2024] Official PyTorch implementation code for realizing the technical part of Mamba-based traversal of rationale (Meteor) to im…☆107Updated 8 months ago