zinengtang / TVLT
PyTorch code for “TVLT: Textless Vision-Language Transformer” (NeurIPS 2022 Oral)
☆121Updated last year
Alternatives and similar repositories for TVLT:
Users that are interested in TVLT are comparing it to the libraries listed below
- Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"☆139Updated 2 years ago
- Align and Prompt: Video-and-Language Pre-training with Entity Prompts☆187Updated 2 years ago
- [NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answering☆185Updated last year
- A PyTorch implementation of EmpiricalMVM☆39Updated last year
- [ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"☆132Updated last year
- An official implementation for "X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval"☆148Updated 10 months ago
- ☆106Updated 2 years ago
- ☆54Updated 2 years ago
- ☆75Updated 2 years ago
- [NeurIPS 2022] Zero-Shot Video Question Answering via Frozen Bidirectional Language Models☆157Updated 2 months ago
- Hierarchical Video-Moment Retrieval and Step-Captioning (CVPR 2023)☆97Updated 3 weeks ago
- Official implementation of "Everything at Once - Multi-modal Fusion Transformer for Video Retrieval". CVPR 2022☆98Updated 2 years ago
- MUSIC-AVQA, CVPR2022 (ORAL)☆75Updated 2 years ago
- ☆84Updated 2 years ago
- PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)☆204Updated 2 years ago
- [SIGIR 2022] CenterCLIP: Token Clustering for Efficient Text-Video Retrieval. Also, a text-video retrieval toolbox based on CLIP + fast p…☆128Updated 2 years ago
- [ICLR2024] Codes and Models for COSA: Concatenated Sample Pretrained Vision-Language Foundation Model☆41Updated last month
- Vision Transformers are Parameter-Efficient Audio-Visual Learners☆96Updated last year
- [CVPR'23 Highlight] AutoAD: Movie Description in Context.☆91Updated 3 months ago
- PyTorch Implementation on Paper [CVPR2021]Distilling Audio-Visual Knowledge by Compositional Contrastive Learning☆85Updated 3 years ago
- L-Verse: Bidirectional Generation Between Image and Text☆108Updated 2 years ago
- [arXiv22] Disentangled Representation Learning for Text-Video Retrieval☆94Updated 2 years ago
- (ACL'2023) MultiCapCLIP: Auto-Encoding Prompts for Zero-Shot Multilingual Visual Captioning☆35Updated 6 months ago
- ☆22Updated last year
- ☆31Updated 3 years ago
- MAD: A Scalable Dataset for Language Grounding in Videos from Movie Audio Descriptions☆158Updated last year
- https://layer6ai-labs.github.io/xpool/☆118Updated last year
- Official code for our CVPR 2023 paper: Test of Time: Instilling Video-Language Models with a Sense of Time☆45Updated 8 months ago
- Summary about Video-to-Text datasets. This repository is part of the review paper *Bridging Vision and Language from the Video-to-Text Pe…☆119Updated last year
- ☆117Updated last year