apsdehal / flava-tutorialsLinks
Tutorials for FLAVA model https://arxiv.org/abs/2112.04482
☆12Updated 2 years ago
Alternatives and similar repositories for flava-tutorials
Users that are interested in flava-tutorials are comparing it to the libraries listed below
Sorting:
- Exploring multimodal fusion-type transformer models for visual question answering (on DAQUAR dataset)☆34Updated 3 years ago
- Companion Repo for the Vision Language Modelling YouTube series - https://bit.ly/3PsbsC2 - by Prithivi Da. Open to PRs and collaborations☆14Updated 2 years ago
- Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.☆34Updated 3 years ago
- This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have b…☆74Updated last year
- Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch☆39Updated 3 years ago
- image captioning with flikr8k dataset☆14Updated 3 years ago
- This repository shows how to implement a basic model for multimodal entailment.☆10Updated 3 years ago
- ☆29Updated last year
- ☆11Updated last year
- Implementation of CaiT models in TensorFlow and ImageNet-1k checkpoints. Includes code for inference and fine-tuning.☆12Updated last year
- An education step by step implementation of SimCLR that accompanies the blogpost☆32Updated 3 years ago
- In-the-wild Question Answering☆15Updated 2 years ago
- Adversarial examples to the new ConvNeXt architecture☆20Updated 3 years ago
- Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch☆101Updated last year
- Generate text captions for images from their embeddings.☆108Updated last year
- Simple script to re-rank images using OpenAI's CLIP https://github.com/openai/CLIP.☆16Updated 4 years ago
- Repo from the "Learning with limited labeled data" seminar @ Uni of Tuebingen. A collection of notes, notebooks and slideshows to underst…☆17Updated 2 years ago
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆23Updated last week
- Implementation of Cross Transformer for spatially-aware few-shot transfer, in Pytorch☆53Updated 4 years ago
- Video descriptions of research papers relating to foundation models and scaling☆31Updated 2 years ago
- ☆11Updated last year
- opentqa is a open framework of the textbook question answering, which includes xtqa, mcan, cmr, mfb, mutan.☆11Updated 4 years ago
- Contains code to demonstrate distributed training in TensorFlow 2 with AI Platform and custom Docker contains.☆20Updated 4 years ago
- PyTorch implementation of FNet: Mixing Tokens with Fourier transforms☆27Updated 4 years ago
- ☆44Updated 3 years ago
- A Pytorch implementation of Attention on Attention module (both self and guided variants), for Visual Question Answering☆43Updated 4 years ago
- Implements RNNPool and SoftPool for CNNs.☆14Updated 4 years ago
- Implementation of Metaformer, but in an autoregressive manner☆25Updated 2 years ago
- CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)☆196Updated last year
- TensorFlow implementation of "TokenLearner: What Can 8 Learned Tokens Do for Images and Videos?"☆33Updated 3 years ago