OFA-Sys / OFA
Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework
☆2,416Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for OFA
- Code for ALBEF: a new vision-language pre-training method☆1,557Updated 2 years ago
- PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation☆4,795Updated 3 months ago
- Code for the ICML 2021 (long talk) paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"☆1,395Updated 7 months ago
- Grounded Language-Image Pre-training☆2,217Updated 9 months ago
- Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch☆1,210Updated 2 years ago
- EVA Series: Visual Representation Fantasies from BAAI☆2,293Updated 3 months ago
- TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.☆1,460Updated this week
- Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch☆1,056Updated 10 months ago
- Awesome list for research on CLIP (Contrastive Language-Image Pre-Training).☆1,134Updated 4 months ago
- An open source implementation of CLIP.☆10,234Updated this week
- LAVIS - A One-stop Library for Language-Vision Intelligence☆9,898Updated 3 weeks ago
- mPLUG-Owl: The Powerful Multi-modal Large Language Model Family☆2,310Updated 3 weeks ago
- An open-source framework for training large multimodal models.☆3,732Updated 2 months ago
- Prompt Learning for Vision-Language Models (IJCV'22, CVPR'22)☆1,761Updated 5 months ago
- Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.☆3,699Updated 3 months ago
- Multimodal-GPT☆1,475Updated last year
- [ECCV2024] Video Foundation Models & Data for Multimodal Understanding☆1,402Updated last month
- A collection of papers on the topic of ``Computer Vision in the Wild (CVinW)''☆1,186Updated 7 months ago
- Meta-Transformer for Unified Multimodal Learning☆1,520Updated 11 months ago
- Painter & SegGPT Series: Vision Foundation Models from BAAI☆2,521Updated last year
- Code and models for the paper "One Transformer Fits All Distributions in Multi-Modal Diffusion"☆1,368Updated last year
- Easily compute clip embeddings and build a clip retrieval system with them☆2,405Updated 6 months ago
- GIT: A Generative Image-to-text Transformer for Vision and Language☆548Updated 11 months ago
- Scenic: A Jax Library for Computer Vision Research and Beyond☆3,322Updated 3 weeks ago
- A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model To…☆964Updated last month
- Simple image captioning model☆1,311Updated 5 months ago
- Caption-Anything is a versatile tool combining image segmentation, visual captioning, and ChatGPT, generating tailored captions with dive…☆1,675Updated last year
- An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"☆876Updated 6 months ago
- [A toolbox for fun.] Transform Image into Unique Paragraph with ChatGPT, BLIP2, OFA, GRIT, Segment Anything, ControlNet.☆789Updated last year
- A PyTorch Lightning solution to training OpenAI's CLIP from scratch.☆664Updated 2 years ago