Alternatives and similar repositories for ViLLa

Users that are interested in ViLLa are comparing it to the libraries listed below

• showlab / VideoLISA
  [NeurlPS 2024] One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos
  ☆135Updated 9 months ago
• congvvc / InstructSeg
  [ICCV 2025] Official implementation of "InstructSeg: Unifying Instructed Visual Segmentation with Multi-modal Large Language Models"
  ☆47Updated 7 months ago
• Rubics-Xuan / MRES
  This repo holds the official code and data for "Unveiling Parts Beyond Objects: Towards Finer-Granularity Referring Expression Segmentati…
  ☆72Updated last year
• lizhou-cs / mglmm
  ☆32Updated last year
• mbzuai-oryx / VideoGLaMM
  [CVPR 2025 🔥]A Large Multimodal Model for Pixel-Level Visual Grounding in Videos
  ☆86Updated 5 months ago
• SuleBai / SC-CLIP
  Self-Calibrated CLIP for Training-Free Open-Vocabulary Segmentation
  ☆55Updated 4 months ago
• buxiangzhiren / VD-IT
  ☆44Updated last year
• callsys / ControlCap
  [ECCV 2024] ControlCap: Controllable Region-level Captioning
  ☆79Updated 11 months ago
• yongliu20 / SCAN
  [CVPR 2024] The repository contains the official implementation of "Open-Vocabulary Segmentation with Semantic-Assisted Calibration"
  ☆75Updated last year
• baoxiaoyi / CoReS
  code for the paper "CoReS: Orchestrating the Dance of Reasoning and Segmentation"
  ☆18Updated 6 months ago
• PKU-ICST-MIPL / DyFo_CVPR2025
  ☆85Updated last month
• appletea233 / LLaVA-ST
  [CVPR 2025] LLaVA-ST: A Multimodal Large Language Model for Fine-Grained Spatial-Temporal Understanding
  ☆68Updated 3 months ago
• appletea233 / AL-Ref-SAM2
  [AAAI 2025] AL-Ref-SAM 2: Unleashing the Temporal-Spatial Reasoning Capacity of GPT for Training-Free Audio and Language Referenced Video…
  ☆88Updated 9 months ago
• yxchng / mask-grounding
  ☆28Updated last year
• cilinyan / ReVOS-api
  [ECCV24] VISA: Reasoning Video Object Segmentation via Large Language Model
  ☆19Updated last year
• jiaosiyu1999 / MAFT-Plus
  ☆58Updated last year
• ProvenceStar / PartGLEE
  [ECCV2024] PartGLEE: A Foundation Model for Recognizing and Parsing Any Objects
  ☆51Updated last year
• lxtGH / DenseWorld-1M
  Code and dataset link for "DenseWorld-1M: Towards Detailed Dense Grounded Caption in the Real World"
  ☆109Updated this week
• HVision-NKU / Cascade-CLIP
  Official implement of ICML2024 Cascade-CLIP: Cascaded Vision-Language Embeddings Alignment for Zero-Shot Semantic Segmentation
  ☆53Updated last year
• HVision-NKU / MaskCLIPpp
  Official repository of the paper "High-Quality Mask Tuning Matters for Open-Vocabulary Segmentation"
  ☆40Updated 6 months ago
• cilinyan / VISA
  [ECCV24] VISA: Reasoning Video Object Segmentation via Large Language Model
  ☆190Updated last year
• haochenheheda / LVVIS
  Large-Vocabulary Video Instance Segmentation dataset
  ☆95Updated last year
• FishAndWasabi / Real-LOD
  Offical implementation of "Re-Aligning Language to Visual Objects with an Agentic Workflow"
  ☆29Updated 5 months ago
• wusize / F-LMM
  [CVPR2025] Code Release of F-LMM: Grounding Frozen Large Multimodal Models
  ☆104Updated 4 months ago
• liuting20 / SwimVG
  Transactions on Multimedia (TMM25)
  ☆16Updated 5 months ago
• clownrat6 / OpenVIS
  [AAAI 2025] Open-vocabulary Video Instance Segmentation Codebase built upon Detectron2, which is really easy to use.
  ☆24Updated 9 months ago
• shilinyan99 / CrossLMM
  CrossLMM: Decoupling Long Video Sequences from LMMs via Dual Cross-Attention Mechanisms
  ☆24Updated 4 months ago
• VCG-team / DiffSegmenter
  Official implementation for "Diffusion Model is Secretly a Training-free Open Vocabulary Semantic Segmenter"
  ☆47Updated last week
• nhw649 / EOV-Seg
  [AAAI 2025] Official implementation of the paper "EOV-Seg: Efficient Open-Vocabulary Panoptic Segmentation"
  ☆31Updated 9 months ago
• zhang9302002 / ThinkingWithVideos
  The official code of "Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning"
  ☆45Updated last month