Alternatives and similar repositories for ControlCap:

Users that are interested in ControlCap are comparing it to the libraries listed below

• wusize / F-LMM
  [CVPR2025] Code Release of F-LMM: Grounding Frozen Large Multimodal Models
  ☆70Updated 7 months ago
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆57Updated 9 months ago
• lizhou-cs / mglmm
  ☆29Updated 5 months ago
• PolyU-ChenLab / ETBench
  👾 E.T. Bench: Towards Open-Ended Event-Level Video-Language Understanding (NeurIPS 2024)
  ☆55Updated last month
• callsys / DynRefer
  [CVPR 2025] DynRefer: Delving into Region-level Multimodal Tasks via Dynamic Resolution
  ☆44Updated 2 weeks ago
• showlab / VideoLISA
  [NeurlPS 2024] One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos
  ☆108Updated 2 months ago
• Paranioar / UniPT
  [CVPR2024] The code of "UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory"
  ☆67Updated 5 months ago
• jianzongwu / betrayed-by-captions
  (ICCV 2023) Betrayed by Captions: Joint Caption Grounding and Generation for Open Vocabulary Instance Segmentation
  ☆47Updated 8 months ago
• wuw2019 / LoTLIP
  [NeurIPS 2024] Official PyTorch implementation of LoTLIP: Improving Language-Image Pre-training for Long Text Understanding
  ☆42Updated 2 months ago
• Visual-AI / PruneVid
  The official repository for paper "PruneVid: Visual Token Pruning for Efficient Video Large Language Models".
  ☆33Updated last month
• congvvc / InstructSeg
  Official implementation of "InstructSeg: Unifying Instructed Visual Segmentation with Multi-modal Large Language Models"
  ☆31Updated last month
• haochenheheda / LVVIS
  Large-Vocabulary Video Instance Segmentation dataset
  ☆81Updated 8 months ago
• Shengcao-Cao / groundLMM
  Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision
  ☆33Updated 4 months ago
• yongliu20 / SCAN
  [CVPR 2024] The repository contains the official implementation of "Open-Vocabulary Segmentation with Semantic-Assisted Calibration"
  ☆68Updated 5 months ago
• jyFengGoGo / InstructDet
  ☆36Updated 11 months ago
• ProvenceStar / PartGLEE
  [ECCV2024] PartGLEE: A Foundation Model for Recognizing and Parsing Any Objects
  ☆40Updated 6 months ago
• mightyzau / RegionBLIP
  ☆58Updated last year
• Zehong-Ma / OVMR
  OVMR: Open-Vocabulary Recognition with Multi-Modal References (CVPR24)
  ☆25Updated 3 months ago
• Rubics-Xuan / MRES
  This repo holds the official code and data for "Unveiling Parts Beyond Objects: Towards Finer-Granularity Referring Expression Segmentati…
  ☆64Updated 9 months ago
• OpenGVLab / LCL
  [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning
  ☆68Updated last month
• ant-research / DreamLIP
  [ECCV 2024] Official PyTorch implementation of DreamLIP: Language-Image Pre-training with Long Captions
  ☆126Updated 3 months ago
• mc-lan / ProxyCLIP
  [ECCV2024] ProxyCLIP: Proxy Attention Improves CLIP for Open-Vocabulary Segmentation
  ☆78Updated last month
• williamium3000 / awesome-mllm-grounding
  Awesome paper for multi-modal llm with grounding ability
  ☆15Updated 7 months ago
• SY-Xuan / Pink
  Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMs
  ☆90Updated 2 months ago
• tripletclip / TripletCLIP
  [NeurIPS 2024] Official PyTorch implementation of "Improving Compositional Reasoning of CLIP via Synthetic Vision-Language Negatives"
  ☆36Updated 3 months ago
• Hon-Wong / Elysium
  [ECCV 2024] Elysium: Exploring Object-level Perception in Videos via MLLM
  ☆68Updated 4 months ago
• callsys / GenPromp
  [ICCV 2023] Generative Prompt Model for Weakly Supervised Object Localization
  ☆57Updated last year
• mc-lan / ClearCLIP
  [ECCV2024] ClearCLIP: Decomposing CLIP Representations for Dense Vision-Language Inference
  ☆76Updated 6 months ago