Alternatives and similar repositories for ControlCap:

Users that are interested in ControlCap are comparing it to the libraries listed below

• wusize / F-LMM
  Code Release of F-LMM: Grounding Frozen Large Multimodal Models
  ☆62Updated 6 months ago
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆55Updated 8 months ago
• callsys / GenPromp
  [ICCV 2023] Generative Prompt Model for Weakly Supervised Object Localization
  ☆55Updated last year
• lizhou-cs / mglmm
  ☆28Updated 4 months ago
• mightyzau / RegionBLIP
  ☆58Updated last year
• Paranioar / UniPT
  [CVPR2024] The code of "UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory"
  ☆66Updated 4 months ago
• wuw2019 / LoTLIP
  [NeurIPS 2024] Official PyTorch implementation of LoTLIP: Improving Language-Image Pre-training for Long Text Understanding
  ☆40Updated last month
• see-say-segment / sesame
  🔥 [CVPR 2024] Official implementation of "See, Say, and Segment: Teaching LMMs to Overcome False Premises (SESAME)"
  ☆32Updated 7 months ago
• showlab / VideoLISA
  [NeurlPS 2024] One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos
  ☆103Updated last month
• jiyt17 / IDA-VLM
  [ICLR 2025] IDA-VLM: Towards Movie Understanding via ID-Aware Large Vision-Language Model
  ☆27Updated 2 months ago
• OpenGVLab / LCL
  [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning
  ☆68Updated this week
• callsys / DynRefer
  DynRefer: Delving into Region-level Multi-modality Tasks via Dynamic Resolution
  ☆39Updated 3 months ago
• Shengcao-Cao / groundLMM
  Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision
  ☆29Updated 3 months ago
• PolyU-ChenLab / ETBench
  👾 E.T. Bench: Towards Open-Ended Event-Level Video-Language Understanding (NeurIPS 2024)
  ☆52Updated 3 weeks ago
• jianzongwu / betrayed-by-captions
  (ICCV 2023) Betrayed by Captions: Joint Caption Grounding and Generation for Open Vocabulary Instance Segmentation
  ☆46Updated 6 months ago
• jyFengGoGo / InstructDet
  ☆34Updated 10 months ago
• bytedance / OmniScient-Model
  This repo contains the code for our paper Towards Open-Ended Visual Recognition with Large Language Model
  ☆93Updated 7 months ago
• ant-research / DreamLIP
  [ECCV 2024] Official PyTorch implementation of DreamLIP: Language-Image Pre-training with Long Captions
  ☆123Updated 2 months ago
• tripletclip / TripletCLIP
  [NeurIPS 2024] Official PyTorch implementation of "Improving Compositional Reasoning of CLIP via Synthetic Vision-Language Negatives"
  ☆33Updated 2 months ago
• Zehong-Ma / OVMR
  OVMR: Open-Vocabulary Recognition with Multi-Modal References (CVPR24)
  ☆24Updated 2 months ago
• kodenii / Ref-Diff
  ☆16Updated last year
• NMS05 / Patch-Aligned-Contrastive-Learning
  ☆20Updated last year
• Hon-Wong / Elysium
  [ECCV 2024] Elysium: Exploring Object-level Perception in Videos via MLLM
  ☆67Updated 3 months ago
• haochenheheda / LVVIS
  Large-Vocabulary Video Instance Segmentation dataset
  ☆78Updated 7 months ago
• Visual-AI / PruneVid
  The official repository for paper "PruneVid: Visual Token Pruning for Efficient Video Large Language Models".
  ☆28Updated last month
• mc-lan / ClearCLIP
  [ECCV2024] ClearCLIP: Decomposing CLIP Representations for Dense Vision-Language Inference
  ☆74Updated 5 months ago
• wdrink / OpenTokenizer
  ☆15Updated 3 weeks ago
• linzhiqiu / visual_gpt_score
  VisualGPTScore for visio-linguistic reasoning
  ☆26Updated last year
• Becomebright / GroundVQA
  Official PyTorch code of "Grounded Question-Answering in Long Egocentric Videos", accepted by CVPR 2024.
  ☆56Updated 5 months ago