zinengtang / TVLT
PyTorch code for “TVLT: Textless Vision-Language Transformer” (NeurIPS 2022 Oral)
☆123Updated 2 years ago
Alternatives and similar repositories for TVLT:
Users that are interested in TVLT are comparing it to the libraries listed below
- Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"☆139Updated 2 years ago
- [ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"☆132Updated last year
- Align and Prompt: Video-and-Language Pre-training with Entity Prompts☆186Updated 2 years ago
- An official implementation for "X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval"☆151Updated 11 months ago
- ☆108Updated 2 years ago
- Use CLIP to represent video for Retrieval Task☆69Updated 4 years ago
- A PyTorch implementation of EmpiricalMVM☆40Updated last year
- [TPAMI2024] Codes and Models for VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset☆281Updated 2 months ago
- [NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answering☆187Updated last year
- ☆75Updated 2 years ago
- [SIGIR 2022] CenterCLIP: Token Clustering for Efficient Text-Video Retrieval. Also, a text-video retrieval toolbox based on CLIP + fast p…☆128Updated 2 years ago
- ☆54Updated 2 years ago
- MUSIC-AVQA, CVPR2022 (ORAL)☆77Updated 2 years ago
- Source code of our MM'22 paper Partially Relevant Video Retrieval☆53Updated 4 months ago
- [arXiv22] Disentangled Representation Learning for Text-Video Retrieval☆96Updated 2 years ago
- Summary about Video-to-Text datasets. This repository is part of the review paper *Bridging Vision and Language from the Video-to-Text Pe…☆120Updated last year
- https://layer6ai-labs.github.io/xpool/☆119Updated last year
- PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)☆204Updated 2 years ago
- Official implementation of "Everything at Once - Multi-modal Fusion Transformer for Video Retrieval". CVPR 2022☆101Updated 2 years ago
- Hierarchical Video-Moment Retrieval and Step-Captioning (CVPR 2023)☆99Updated last month
- ☆84Updated 2 years ago
- ☆20Updated 2 years ago
- Vision Transformers are Parameter-Efficient Audio-Visual Learners☆99Updated last year
- PyTorch Implementation on Paper [CVPR2021]Distilling Audio-Visual Knowledge by Compositional Contrastive Learning☆84Updated 3 years ago
- (ACL'2023) MultiCapCLIP: Auto-Encoding Prompts for Zero-Shot Multilingual Visual Captioning☆35Updated 7 months ago
- A Unified Framework for Video-Language Understanding☆57Updated last year
- Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners☆113Updated 2 years ago
- This repository contains the code for our ECCV 2022 paper "Temporal and cross-modal attention for audio-visual zero-shot learning"☆24Updated 2 years ago
- [ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videos☆119Updated last year
- [ICLR2024] Codes and Models for COSA: Concatenated Sample Pretrained Vision-Language Foundation Model☆42Updated 2 months ago