apsdehal / flava-tutorials
Tutorials for FLAVA model https://arxiv.org/abs/2112.04482
☆12Updated 2 years ago
Alternatives and similar repositories for flava-tutorials
Users that are interested in flava-tutorials are comparing it to the libraries listed below
Sorting:
- This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have b…☆74Updated last year
- Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.☆34Updated 3 years ago
- Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch☆38Updated 3 years ago
- Implementation of CaiT models in TensorFlow and ImageNet-1k checkpoints. Includes code for inference and fine-tuning.☆12Updated last year
- opentqa is a open framework of the textbook question answering, which includes xtqa, mcan, cmr, mfb, mutan.☆11Updated 4 years ago
- Video descriptions of research papers relating to foundation models and scaling☆31Updated 2 years ago
- SimVLM ---SIMPLE VISUAL LANGUAGE MODEL PRETRAINING WITH WEAK SUPERVISION☆36Updated 2 years ago
- PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)☆72Updated last year
- PyTorch implementation of FNet: Mixing Tokens with Fourier transforms☆27Updated 4 years ago
- Code repository for Rakuten Data Challenge: Multimodal Product Classification and Retrieval.☆26Updated 4 years ago
- In-the-wild Question Answering☆15Updated 2 years ago
- ☆28Updated last year
- [TMLR 2022] High-Modality Multimodal Transformer☆115Updated 6 months ago
- A curated list of vision-and-language pre-training (VLP). :-)☆58Updated 2 years ago
- An education step by step implementation of SimCLR that accompanies the blogpost☆32Updated 3 years ago
- ☆33Updated 2 years ago
- image captioning with flikr8k dataset☆14Updated 3 years ago
- ☆20Updated 3 years ago
- Companion Repo for the Vision Language Modelling YouTube series - https://bit.ly/3PsbsC2 - by Prithivi Da. Open to PRs and collaborations☆14Updated 2 years ago
- ☆37Updated last year
- Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch☆101Updated last year
- [CVPRW22] Official Implementation of T-Food: "Transformer Decoders with MultiModal Regularization for Cross-Modal Food Retrieval". Accept…☆32Updated 2 years ago
- Adversarial examples to the new ConvNeXt architecture☆20Updated 3 years ago
- Mr. Right: Multimodal Retrieval on Representation of ImaGe witH Text☆24Updated 2 years ago
- Codebase for HuBMAP + HPA - Hacking the Human Body: Human Torus Team solution (3d Place)☆16Updated 2 years ago
- This repository shows how to implement a basic model for multimodal entailment.☆10Updated 3 years ago
- Production-ready template for PyTorch Deep Learning Projects☆9Updated 3 years ago
- ☆59Updated 3 years ago
- ☆44Updated 3 years ago
- Generate text captions for images from their embeddings.☆106Updated last year