YehLi / xmodalerLinks
X-modaler is a versatile and high-performance codebase for cross-modal analytics(e.g., image captioning, video captioning, vision-language pre-training, visual question answering, visual commonsense reasoning, and cross-modal retrieval).
☆967Updated 2 years ago
Alternatives and similar repositories for xmodaler
Users that are interested in xmodaler are comparing it to the libraries listed below
Sorting:
- [CVPR 2021 Best Student Paper Honorable Mention, Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning…☆723Updated 2 years ago
- Multi-Modal learning toolkit based on PaddlePaddle and PyTorch, supporting multiple applications such as multi-modal classification, cros…☆476Updated 2 years ago
- ☆101Updated 4 years ago
- VideoX: a collection of video cross-modal models☆1,046Updated last year
- A general video understanding codebase from SenseTime X-Lab☆446Updated 4 years ago
- This repository focus on Image Captioning & Video Captioning & Seq-to-Seq Learning & NLP☆414Updated 2 years ago
- The official source code for the paper Consensus-Aware Visual-Semantic Embedding for Image-Text Matching (ECCV 2020)☆167Updated 3 years ago
- Implementation of 'X-Linear Attention Networks for Image Captioning' [CVPR 2020]☆275Updated 4 years ago
- Meshed-Memory Transformer for Image Captioning. CVPR 2020☆539Updated 2 years ago
- A curated list of deep learning resources for video-text retrieval.☆631Updated 2 years ago
- An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"☆362Updated last year
- The Paper List of Large Multi-Modality Model (Perception, Generation, Unification), Parameter-Efficient Finetuning, Vision-Language Pretr…☆430Updated 3 weeks ago
- Oscar and VinVL☆1,050Updated 2 years ago
- X-VLM: Multi-Grained Vision Language Pre-Training (ICML 2022)☆484Updated 2 years ago
- [ECCV 2022] & [IJCV 2024] Official implementation of the paper: Audio-Visual Segmentation (with Semantics)☆402Updated 11 months ago
- An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"☆991Updated last year
- METER: A Multimodal End-to-end TransformER Framework☆373Updated 2 years ago
- A PyTorch reimplementation of bottom-up-attention models☆304Updated 3 years ago
- PyTorch code for EMNLP 2019 paper "LXMERT: Learning Cross-Modality Encoder Representations from Transformers".☆963Updated 2 years ago
- Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"☆798Updated 4 years ago
- PyTorch source code for "Stacked Cross Attention for Image-Text Matching" (ECCV 2018)☆571Updated 2 years ago
- Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".☆746Updated 2 years ago
- Multi-Modal Transformer for Video Retrieval☆262Updated last year
- 【CVPR'2023 Highlight & TPAMI】Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?☆244Updated 10 months ago
- Recent Advances in Vision and Language PreTrained Models (VL-PTMs)☆1,155Updated 3 years ago
- Video embeddings for retrieval with natural language queries☆342Updated 2 years ago
- Code for the ICML 2021 (long talk) paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"☆1,499Updated last year
- [CVPR2021] The source code for our paper 《Removing the Background by Adding the Background: Towards Background Robust Self-supervised Vid…☆135Updated 4 years ago
- ☆254Updated 2 years ago
- code for TCL: Vision-Language Pre-Training with Triple Contrastive Learning, CVPR 2022☆266Updated last year