Alternatives and similar repositories for Osprey

Users that are interested in Osprey are comparing it to the libraries listed below

• shenyunhang / APE
  [CVPR 2024] Aligning and Prompting Everything All at Once for Universal Visual Perception
  ☆566Updated last year
• FoundationVision / GLEE
  [CVPR2024 Highlight]GLEE: General Object Foundation Model for Images and Videos at Scale
  ☆1,128Updated 7 months ago
• dvlab-research / LLaMA-VID
  LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)
  ☆809Updated 10 months ago
• FoundationVision / Groma
  [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization
  ☆565Updated 11 months ago
• magic-research / Sa2VA
  🔥 Sa2VA: Marrying SAM2 with LLaVA for Dense Grounded Understanding of Images and Videos
  ☆1,103Updated last week
• dvlab-research / LISA
  Project Page for "LISA: Reasoning Segmentation via Large Language Model"
  ☆2,227Updated 3 months ago
• HarborYuan / ovsam
  [ECCV 2024] The official code of paper "Open-Vocabulary SAM".
  ☆970Updated 10 months ago
• mbzuai-oryx / groundingLMM
  [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses tha…
  ☆883Updated 6 months ago
• OpenGVLab / all-seeing
  [ICLR 2024 & ECCV 2024] The All-Seeing Projects: Towards Panoptic Visual Recognition&Understanding and General Relation Comprehension of …
  ☆485Updated 9 months ago
• baaivision / tokenize-anything
  [ECCV 2024] Tokenize Anything via Prompting
  ☆582Updated 5 months ago
• xmoanvaf / llava-phi
  ☆382Updated 5 months ago
• shikras / shikra
  ☆778Updated 10 months ago
• MaverickRen / PixelLM
  [CVPR 2024] PixelLM is an effective and efficient LMM for pixel-level reasoning and understanding.
  ☆223Updated 3 months ago
• rese1f / MovieChat
  [CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding
  ☆621Updated 4 months ago
• AILab-CVC / SEED-X
  Multimodal Models in Real World
  ☆508Updated 3 months ago
• LLaVA-VL / LLaVA-Interactive-Demo
  LLaVA-Interactive-Demo
  ☆371Updated 10 months ago
• SunzeY / AlphaCLIP
  [CVPR 2024] Alpha-CLIP: A CLIP Model Focusing on Wherever You Want
  ☆821Updated 10 months ago
• ShareGPT4Omni / ShareGPT4Video
  [NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions
  ☆1,057Updated 7 months ago
• lzw-lzw / GroundingGPT
  [ACL 2024] GroundingGPT: Language-Enhanced Multi-modal Grounding Model
  ☆331Updated 6 months ago
• OpenGVLab / VisionLLM
  VisionLLM Series
  ☆1,066Updated 3 months ago
• lxtGH / OMG-Seg
  OMG-LLaVA and OMG-Seg codebase [CVPR-24 and NeurIPS-24]
  ☆1,293Updated 5 months ago
• jshilong / GPT4RoI
  GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest
  ☆528Updated 11 months ago
• RunpeiDong / DreamLLM
  [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation
  ☆441Updated 6 months ago
• PKU-YuanGroup / LanguageBind
  【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment
  ☆810Updated last year
• NExT-ChatV / NExT-Chat
  The code of the paper "NExT-Chat: An LMM for Chat, Detection and Segmentation".
  ☆244Updated last year
• BAAI-DCAI / Bunny
  A family of lightweight multimodal models.
  ☆1,018Updated 6 months ago
• magic-research / PLLaVA
  Official repository for the paper PLLaVA
  ☆651Updated 10 months ago
• AILab-CVC / SEED
  Official implementation of SEED-LLaMA (ICLR 2024).
  ☆613Updated 8 months ago
• Oryx-mllm / Oryx
  [ICLR 2025] MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution
  ☆308Updated 3 months ago
• LLaVA-VL / LLaVA-Plus-Codebase
  LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
  ☆743Updated last year