microsoft / XPretrain
Multi-modality pre-training
☆482Updated 9 months ago
Alternatives and similar repositories for XPretrain:
Users that are interested in XPretrain are comparing it to the libraries listed below
- [ICCV2023 Oral] Unmasked Teacher: Towards Training-Efficient Video Foundation Models☆316Updated 8 months ago
- Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval [ICCV'21]☆357Updated 2 years ago
- [NIPS2023] Code and Model for VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset☆265Updated 11 months ago
- An official implementation for "X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval"☆149Updated 10 months ago
- [NeurIPS 2021] Moment-DETR code and QVHighlights dataset☆285Updated 10 months ago
- [CVPR2023] All in One: Exploring Unified Video-Language Pre-training☆280Updated last year
- Align and Prompt: Video-and-Language Pre-training with Entity Prompts☆187Updated 2 years ago
- Large-scale text-video dataset. 10 million captioned short videos.☆623Updated 6 months ago
- [TPAMI2024] Codes and Models for VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset☆277Updated last month
- [CVPR 2023] Official repository of paper titled "Fine-tuned CLIP models are efficient video learners".☆264Updated 10 months ago
- An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"☆909Updated 10 months ago
- [CVPR 2024] Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers☆572Updated 3 months ago
- mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video (ICML 2023)☆223Updated last year
- [ICCV2023] UniVTG: Towards Unified Video-Language Temporal Grounding☆337Updated 9 months ago
- VideoChat-Flash: Hierarchical Compression for Long-Context Video Modeling☆302Updated last week
- A curated list of deep learning resources for video-text retrieval.☆605Updated last year
- [NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answering☆185Updated last year
- ☆239Updated 2 years ago
- Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm☆645Updated 2 years ago
- [CVPR 2024] TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding☆335Updated 3 months ago
- GRiT: A Generative Region-to-text Transformer for Object Understanding (https://arxiv.org/abs/2212.00280)☆312Updated last year
- An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"☆343Updated 6 months ago
- GIT: A Generative Image-to-text Transformer for Vision and Language☆556Updated last year
- CLIPScore EMNLP code☆210Updated 2 years ago
- [NeurIPS 2022] Zero-Shot Video Question Answering via Frozen Bidirectional Language Models☆156Updated 2 months ago
- Official code for "Bridging Video-text Retrieval with Multiple Choice Questions", CVPR 2022 (Oral).☆138Updated 2 years ago
- Recent Advances in Vision and Language Pre-training (VLP)☆292Updated last year
- Supercharged BLIP-2 that can handle videos☆117Updated last year
- Summary about Video-to-Text datasets. This repository is part of the review paper *Bridging Vision and Language from the Video-to-Text Pe…☆120Updated last year
- [CVPR'2024 Highlight] Official PyTorch implementation of the paper "VTimeLLM: Empower LLM to Grasp Video Moments".☆250Updated 8 months ago