Alternatives and similar repositories for ViLLa

Users that are interested in ViLLa are comparing it to the libraries listed below

• Rubics-Xuan / MRES
  This repo holds the official code and data for "Unveiling Parts Beyond Objects: Towards Finer-Granularity Referring Expression Segmentati…
  ☆70Updated last year
• congvvc / InstructSeg
  Official implementation of "InstructSeg: Unifying Instructed Visual Segmentation with Multi-modal Large Language Models"
  ☆41Updated 4 months ago
• showlab / VideoLISA
  [NeurlPS 2024] One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos
  ☆122Updated 6 months ago
• buxiangzhiren / VD-IT
  ☆43Updated 8 months ago
• AI-Application-and-Integration-Lab / SAM4MLLM
  [ECCV 2024] SAM4MLLM: Enhance Multi-Modal Large Language Model for Referring Expression Segmentation,
  ☆30Updated 3 months ago
• mbzuai-oryx / VideoGLaMM
  [CVPR 2025 🔥]A Large Multimodal Model for Pixel-Level Visual Grounding in Videos
  ☆73Updated 2 months ago
• baoxiaoyi / CoReS
  code for the paper "CoReS: Orchestrating the Dance of Reasoning and Segmentation"
  ☆17Updated 3 months ago
• callsys / ControlCap
  [ECCV 2024] ControlCap: Controllable Region-level Captioning
  ☆77Updated 8 months ago
• Tavarich / Awesome-Referring-Video-Object-Segmentation
  A list of referring video object segmentation papers
  ☆41Updated 2 weeks ago
• yongliu20 / SCAN
  [CVPR 2024] The repository contains the official implementation of "Open-Vocabulary Segmentation with Semantic-Assisted Calibration"
  ☆72Updated 9 months ago
• HVision-NKU / Cascade-CLIP
  Official implement of ICML2024 Cascade-CLIP: Cascaded Vision-Language Embeddings Alignment for Zero-Shot Semantic Segmentation
  ☆51Updated 10 months ago
• wusize / F-LMM
  [CVPR2025] Code Release of F-LMM: Grounding Frozen Large Multimodal Models
  ☆95Updated 3 weeks ago
• lizhou-cs / mglmm
  ☆31Updated 8 months ago
• jianzongwu / betrayed-by-captions
  (ICCV 2023) Betrayed by Captions: Joint Caption Grounding and Generation for Open Vocabulary Instance Segmentation
  ☆47Updated 11 months ago
• Visual-AI / PruneVid
  The official repository for ACL2025 paper "PruneVid: Visual Token Pruning for Efficient Video Large Language Models".
  ☆46Updated last month
• mightyzau / RegionBLIP
  ☆58Updated last year
• TimeMarker-LLM / TimeMarker
  A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Ability
  ☆94Updated 6 months ago
• appletea233 / Temporal-R1
  Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency
  ☆42Updated 2 weeks ago
• cilinyan / ReVOS-api
  [ECCV24] VISA: Reasoning Video Object Segmentation via Large Language Model
  ☆17Updated 11 months ago
• Visual-AI / FROSTER
  The official repository for ICLR2024 paper "FROSTER: Frozen CLIP is a Strong Teacher for Open-Vocabulary Action Recognition"
  ☆80Updated 5 months ago
• DongSky / MR-GDINO
  ☆45Updated 6 months ago
• SuleBai / SC-CLIP
  Self-Calibrated CLIP for Training-Free Open-Vocabulary Segmentation
  ☆48Updated last month
• wusize / CLIM
  [AAAI2024] Code Release of CLIM: Contrastive Language-Image Mosaic for Region Representation
  ☆29Updated last year
• liuting20 / SwimVG
  Transactions on Multimedia (TMM25)
  ☆15Updated 2 months ago
• clownrat6 / OpenVIS
  Open-vocabulary Video Instance Segmentation Codebase built upon Detectron2, which is really easy to use.
  ☆23Updated 5 months ago
• hanghuacs / FineCaption
  ☆32Updated this week
• Zehong-Ma / OVMR
  OVMR: Open-Vocabulary Recognition with Multi-Modal References (CVPR24)
  ☆31Updated last week
• wdrink / OpenTokenizer
  ☆21Updated 5 months ago
• hmxiong / StreamChat
  Official repo for "Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledge" ICLR2025
  ☆55Updated 3 months ago
• appletea233 / LLaVA-ST
  [CVPR 2025] LLaVA-ST: A Multimodal Large Language Model for Fine-Grained Spatial-Temporal Understanding
  ☆46Updated 2 weeks ago