whwu95 / Cap4Video
【CVPR'2023 Highlight & TPAMI】Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?
☆226Updated last week
Related projects: ⓘ
- 【CVPR'2023】Bidirectional Cross-Modal Knowledge Exploration for Video Recognition with Pre-trained Vision-Language Models☆156Updated last week
- 【AAAI'2023 & IJCV】Transferring Vision-Language Models for Visual Recognition: A Classifier Perspective☆202Updated 3 months ago
- 【ICCV'2023】What Can Simple Arithmetic Operations Do for Temporal Modeling?☆73Updated 7 months ago
- FACTUAL benchmark dataset, the pre-trained textual scene graph parser trained on FACTUAL.☆96Updated last month
- GPT4Vis: What Can GPT-4 Do for Zero-shot Visual Recognition?☆202Updated 3 months ago
- [CVPR 2023] Official implementation of the paper: Fine-grained Audible Video Description☆74Updated 9 months ago
- Multi-granularity Correspondence Learning from Long-term Noisy Videos [ICLR 2024, Oral]☆106Updated 5 months ago
- Learning Semantic Relationship among Instances for Image-Text Matching, CVPR, 2023☆85Updated 10 months ago
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆537Updated 3 months ago
- An open-source implementation for training LLaVA-NeXT.☆243Updated 3 months ago
- OmniTokenizer: one model and one weight for image-video joint tokenization.☆228Updated 2 months ago
- Evaluating Vision & Language Pretraining Models with Objects, Attributes and Relations.☆124Updated last year
- [NeurIPS 2022 Spotlight] Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations☆113Updated 5 months ago
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆260Updated 5 months ago
- (ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generator☆77Updated 3 months ago
- ☆166Updated last year
- An official implementation for "X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval"☆127Updated 5 months ago
- Mathematical Visual Instruction Tuning for Multi-modal Large Language Models☆86Updated last month
- [ICCV2023 Oral] Unmasked Teacher: Towards Training-Efficient Video Foundation Models☆282Updated 3 months ago
- Pytorch Code for "Unified Coarse-to-Fine Alignment for Video-Text Retrieval" (ICCV 2023)☆50Updated 3 months ago
- [CVPR 2023] Prompt, Generate, then Cache: Cascade of Foundation Models makes Strong Few-shot Learners☆343Updated last year
- Official pytorch repository for CG-DETR "Correlation-guided Query-Dependency Calibration in Video Representation Learning for Temporal Gr…☆109Updated 3 weeks ago
- Awesome papers & datasets specifically focused on long-term videos.☆157Updated 2 months ago
- Linguistic-Aware Patch Slimming Framework for Fine-grained Cross-Modal Alignment, CVPR, 2024☆69Updated 3 months ago
- Official implementation of "Towards Efficient Visual Adaption via Structural Re-parameterization".☆192Updated 5 months ago
- Cross-modal few-shot adaptation with CLIP☆304Updated 6 months ago
- [CVPR 2023 Highlight] Video-Text as Game Players: Hierarchical Banzhaf Interaction for Cross-Modal Representation Learning☆103Updated 5 months ago
- [ICCV 2023] Spectrum-guided Multi-granularity Referring Video Object Segmentation.☆78Updated 11 months ago
- [CVPR2023] All in One: Exploring Unified Video-Language Pre-training☆278Updated last year
- [arXiv22] Disentangled Representation Learning for Text-Video Retrieval☆89Updated 2 years ago