Alternatives and similar repositories for Sa2VA:

Users that are interested in Sa2VA are comparing it to the libraries listed below

• Mark12Ding / SAM2Long
  SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Tree
  ☆531Updated last month
• FoundationVision / Groma
  [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization
  ☆524Updated 7 months ago
• Oryx-mllm / Oryx
  MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution
  ☆272Updated 3 weeks ago
• HarborYuan / ovsam
  [ECCV 2024] The official code of paper "Open-Vocabulary SAM".
  ☆919Updated 5 months ago
• DAMO-NLP-SG / VideoRefer
  The code for "VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM"
  ☆133Updated last week
• ShareGPT4Omni / ShareGPT4Video
  [NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions
  ☆1,012Updated 3 months ago
• zibojia / COCOCO
  Video-Inpaint-Anything: This is the inference code for our paper CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, C…
  ☆252Updated 3 months ago
• microsoft / VidTok
  a family of versatile and state-of-the-art video tokenizers.
  ☆300Updated this week
• NVlabs / EAGLE
  EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders
  ☆528Updated 3 months ago
• lxtGH / OMG-Seg
  OMG-LLaVA and OMG-Seg codebase [CVPR-24 and NeurIPS-24]
  ☆1,199Updated last month
• MinghanLi / UniVS
  Code release for "UniVS: Unified and Universal Video Segmentation with Prompts as Queries" (CVPR2024)
  ☆168Updated last month
• baaivision / See3D
  You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scale
  ☆576Updated 3 weeks ago
• AlaaLab / InstructCV
  [ ICLR 2024 ] Official Codebase for "InstructCV: Instruction-Tuned Text-to-Image Diffusion Models as Vision Generalists"
  ☆462Updated 8 months ago
• CircleRadon / TokenPacker
  The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".
  ☆227Updated 3 weeks ago
• FoundationVision / OmniTokenizer
  [NeurIPS 2024]OmniTokenizer: one model and one weight for image-video joint tokenization.
  ☆269Updated 6 months ago
• dvlab-research / LLMGA
  This project is the official implementation of 'LLMGA: Multimodal Large Language Model based Generation Assistant', ECCV2024 Oral
  ☆383Updated 5 months ago
• baaivision / tokenize-anything
  [ECCV 2024] Tokenize Anything via Prompting
  ☆557Updated last month
• hustvl / EVF-SAM
  Official code of "EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Model"
  ☆331Updated this week
• Vchitect / Vchitect-2.0
  Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Models
  ☆602Updated 3 months ago
• NJU-PCALab / RAG-Diffusion
  Region-Aware Text-to-Image Generation via Hard Binding and Soft Refinement 🔥
  ☆488Updated last week
• dvlab-research / Lyra
  Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition
  ☆263Updated last week
• xk-huang / segment-caption-anything
  [CVPR 24] The repository provides code for running inference and training for "Segment and Caption Anything" (SCA) , links for downloadin…
  ☆209Updated 3 months ago
• xiaoachen98 / Open-LLaVA-NeXT
  An open-source implementation for training LLaVA-NeXT.
  ☆363Updated 2 months ago
• linzhiqiu / t2v_metrics
  Evaluating text-to-image/video/3D models with VQAScore
  ☆232Updated last week
• zamling / PSALM
  [ECCV2024] This is an official implementation for "PSALM: Pixelwise SegmentAtion with Large Multi-Modal Model"
  ☆209Updated 2 weeks ago
• wanghao9610 / OV-DINO
  Official implementation of OV-DINO: Unified Open-Vocabulary Detection with Language-Aware Selective Fusion
  ☆283Updated this week
• jyLin8100 / GenSAM
  Code for AAAl 2024 paper: Relax Image-Specific Prompt Requirement in SAM: A Single Generic Prompt for Segmenting Camouflaged Objects
  ☆136Updated 3 months ago
• SkyworkAI / Vitron
  NeurIPS 2024 Paper: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editing
  ☆463Updated 2 months ago
• shenyunhang / APE
  [CVPR 2024] Aligning and Prompting Everything All at Once for Universal Visual Perception
  ☆502Updated 8 months ago
• FoundationVision / GLEE
  [CVPR2024 Highlight]GLEE: General Object Foundation Model for Images and Videos at Scale
  ☆1,073Updated 2 months ago