[CVPR 2021 Best Student Paper Honorable Mention, Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning on image-text and video-text tasks.
☆732Aug 8, 2023Updated 3 years ago
Alternatives and similar repositories for ClipBERT
Users that are interested in ClipBERT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"☆1,034Apr 12, 2024Updated 2 years ago
- Research code for EMNLP 2020 paper "HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training"☆235Sep 16, 2021Updated 5 years ago
- ☆259Dec 10, 2022Updated 3 years ago
- Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval [ICCV'21]☆380May 19, 2022Updated 4 years ago
- A PyTorch implementation of VIOLET☆138Dec 17, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"☆365Jul 25, 2024Updated 2 years ago
- Multi-Modal Transformer for Video Retrieval☆266Oct 9, 2024Updated 2 years ago
- Align and Prompt: Video-and-Language Pre-training with Entity Prompts☆189May 1, 2025Updated last year
- [ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videos☆127Sep 29, 2023Updated 3 years ago
- [CVPR2023] All in One: Exploring Unified Video-Language Pre-training☆281Mar 25, 2023Updated 3 years ago
- A curated list of deep learning resources for video-text retrieval.☆647Oct 20, 2023Updated 3 years ago
- Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".☆741May 22, 2023Updated 3 years ago
- Oscar and VinVL☆1,053Aug 28, 2023Updated 3 years ago
- Recent Advances in Vision and Language PreTrained Models (VL-PTMs)☆1,161Aug 19, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"☆136May 5, 2023Updated 3 years ago
- Video embeddings for retrieval with natural language queries☆345Feb 15, 2023Updated 3 years ago
- Data Release for VALUE Benchmark☆30Feb 16, 2022Updated 4 years ago
- MERLOT: Multimodal Neural Script Knowledge Models☆226Mar 15, 2022Updated 4 years ago
- PyTorch GPU distributed training code for MIL-NCE HowTo100M☆221Jul 5, 2022Updated 4 years ago
- [ICLR 2022] code for "How Much Can CLIP Benefit Vision-and-Language Tasks?" https://arxiv.org/abs/2107.06383☆423Oct 28, 2022Updated 4 years ago
- PyTorch code for EMNLP 2019 paper "LXMERT: Learning Cross-Modality Encoder Representations from Transformers".☆969Oct 22, 2022Updated 4 years ago
- Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"☆801Jun 30, 2021Updated 5 years ago
- [CVPR'21 Oral] Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning☆208Sep 30, 2022Updated 4 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆73Jun 3, 2022Updated 4 years ago
- [NeurIPS 2021] Moment-DETR code and QVHighlights dataset☆358Mar 9, 2026Updated 8 months ago
- [CVPR 2021] VirTex: Learning Visual Representations from Textual Annotations☆564Aug 22, 2025Updated last year
- Code for ALBEF: a new vision-language pre-training method☆1,754Sep 20, 2022Updated 4 years ago
- COOT: Cooperative Hierarchical Transformer for Video-Text Representation Learning☆291Sep 6, 2022Updated 4 years ago
- Use CLIP to represent video for Retrieval Task☆71Mar 1, 2021Updated 5 years ago
- Data and code for CVPR 2020 paper: "VIOLIN: A Large-Scale Dataset for Video-and-Language Inference"☆161Apr 29, 2020Updated 6 years ago
- [ACL 2020] PyTorch code for TVQA+: Spatio-Temporal Grounding for Video Question Answering☆133Oct 25, 2022Updated 4 years ago
- Implementation for the paper "Hierarchical Conditional Relation Networks for Video Question Answering" (Le et al., CVPR 2020, Oral)☆135Jul 25, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Code for the ICML 2021 (long talk) paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"☆1,537Apr 3, 2024Updated 2 years ago
- VideoX: a collection of video cross-modal models☆1,071Jun 3, 2024Updated 2 years ago
- ☆1,055Oct 3, 2022Updated 4 years ago
- [ECCV 2020] PyTorch code for XML on TVRetrieval dataset - TVR: A Large-Scale Dataset for Video-Subtitle Moment Retrieval☆164May 28, 2024Updated 2 years ago
- [ACL 2021] mTVR: Multilingual Video Moment Retrieval☆28Aug 20, 2022Updated 4 years ago
- S3D Text-Video model trained on HowTo100M using MIL-NCE☆200Jul 3, 2020Updated 6 years ago
- Multi Task Vision and Language☆821Feb 16, 2022Updated 4 years ago
Are these results useful?