Alternatives and similar repositories for CaptionQA

Users that are interested in CaptionQA are comparing it to the libraries listed below

• Haochen-Wang409 / ross
  [ICLR'25] Reconstructive Visual Instruction Tuning
  ☆129Updated 8 months ago
• wdrink / OpenTokenizer
  ☆21Updated 10 months ago
• rese1f / aurora
  [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark
  ☆133Updated 6 months ago
• JoeLeelyf / OVO-Bench
  [CVPR 2025] OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?
  ☆105Updated 4 months ago
• dhg-wei / TOPA
  (NeurIPS 2024 Spotlight) TOPA: Extend Large Language Models for Video Understanding via Text-Only Pre-Alignment
  ☆30Updated last year
• qiulu66 / EgoPlan-Bench2
  ☆26Updated 7 months ago
• rongyaofang / PUMA
  Empowering Unified MLLM with Multi-granular Visual Generation
  ☆130Updated 10 months ago
• zhang9302002 / ThinkingWithVideos
  The official code of "Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning"
  ☆68Updated last month
• Share14 / ShareGemini
  ☆32Updated last year
• xichenpan / Kosmos-G
  Official Implementation of ICLR'24: Kosmos-G: Generating Images in Context with Multimodal Large Language Models
  ☆74Updated last year
• facebookresearch / metaquery
  Official Implementation of Paper Transfer between Modalities with MetaQueries
  ☆272Updated last month
• ChocoWu / SeTok
  Codes for ICLR 2025 Paper: Towards Semantic Equivalence of Tokenization in Multimodal LLM
  ☆75Updated 7 months ago
• egolife-ai / Ego-R1
  Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoning
  ☆131Updated 3 months ago
• lxtGH / DenseWorld-1M
  Code and dataset link for "DenseWorld-1M: Towards Detailed Dense Grounded Caption in the Real World"
  ☆116Updated 2 months ago
• showlab / VideoLISA
  [NeurlPS 2024] One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos
  ☆143Updated 11 months ago
• Visual-AI / PruneVid
  [ACL 2025] PruneVid: Visual Token Pruning for Efficient Video Large Language Models
  ☆60Updated 6 months ago
• hmxiong / StreamChat
  Official repo for "Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledge" ICLR2025
  ☆89Updated 8 months ago
• baaivision / DenseFusion
  DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception
  ☆158Updated last year
• PolyU-ChenLab / ETBench
  👾 E.T. Bench: Towards Open-Ended Event-Level Video-Language Understanding (NeurIPS 2024)
  ☆71Updated 10 months ago
• 360CVGroup / PlanGen
  Unified layout planning and image generation, ICCV2025
  ☆36Updated 7 months ago
• NVlabs / QLIP
  [arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation
  ☆94Updated 9 months ago
• SilentView / LVD-2M
  [NeurIPS 2024 D&B Track] Official Repo for "LVD-2M: A Long-take Video Dataset with Temporally Dense Captions"
  ☆73Updated last year
• ziqipang / MR-Video
  MR. Video: MapReduce is the Principle for Long Video Understanding
  ☆28Updated 7 months ago
• mightyzau / RegionBLIP
  ☆58Updated 2 years ago
• callsys / ControlCap
  [ECCV 2024] ControlCap: Controllable Region-level Captioning
  ☆80Updated last year
• appletea233 / Temporal-R1
  Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency
  ☆58Updated 6 months ago
• OpenGVLab / LCL
  [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning
  ☆70Updated 9 months ago
• wusize / Harmon
  [ICCV2025]Code Release of Harmonizing Visual Representations for Unified Multimodal Understanding and Generation
  ☆178Updated 6 months ago
• qiujihao19 / Artemis
  ☆27Updated 8 months ago
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆76Updated last year