Implementation of the deepmind Flamingo vision-language model, based on Hugging Face language models and ready for training
☆170Apr 27, 2023Updated 3 years ago
Alternatives and similar repositories for flamingo-mini
Users that are interested in flamingo-mini are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch☆1,268Oct 18, 2022Updated 3 years ago
- An open-source framework for training large multimodal models.☆4,115Aug 31, 2024Updated 2 years ago
- ☆11Nov 21, 2024Updated last year
- MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.☆953Mar 19, 2025Updated last year
- Using pretrained encoder and language models to generate captions from multimedia inputs.☆101Mar 11, 2023Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- SimVLM ---SIMPLE VISUAL LANGUAGE MODEL PRETRAINING WITH WEAK SUPERVISION☆36Nov 7, 2022Updated 3 years ago
- 🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".☆482Oct 30, 2023Updated 2 years ago
- Repository for the paper "Data Efficient Masked Language Modeling for Vision and Language".☆18Sep 17, 2021Updated 5 years ago
- ☆12Mar 14, 2023Updated 3 years ago
- SVIT: Scaling up Visual Instruction Tuning☆168Jun 20, 2024Updated 2 years ago
- This repository contains code and dataset splits for the paper "Classification by Attention: Scene Graph Classification with Prior Knowle…☆16May 27, 2022Updated 4 years ago
- ☆13Aug 12, 2026Updated last month
- DataComp: In search of the next generation of multimodal datasets☆792Apr 28, 2025Updated last year
- 🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing imp…☆3,440Mar 5, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆134Dec 22, 2023Updated 2 years ago
- Implementation of LaTr: Layout-aware transformer for scene-text VQA,a novel multimodal architecture for Scene Text Visual Question Answer…☆56Jul 22, 2026Updated 2 months ago
- Official implementation of SEED-LLaMA (ICLR 2024).☆641Sep 21, 2024Updated 2 years ago
- Chain of Images for Intuitively Reasoning☆10Nov 29, 2023Updated 2 years ago
- This code provides a PyTorch implementation for OTTER (Optimal Transport distillation for Efficient zero-shot Recognition), as described …☆71Dec 20, 2021Updated 4 years ago
- ☆25Jun 5, 2023Updated 3 years ago
- ☆202May 10, 2023Updated 3 years ago
- [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters☆5,913Mar 14, 2024Updated 2 years ago
- Official code for the ICLR2023 paper Compositional Prompt Tuning with Motion Cues for Open-vocabulary Video Relation Detection☆43Jun 4, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- GRiT: A Generative Region-to-text Transformer for Object Understanding (ECCV2024)☆342Jan 8, 2024Updated 2 years ago
- Deep Learning for Video Retrieval by Natural Language☆11Oct 20, 2019Updated 6 years ago
- GIT: A Generative Image-to-text Transformer for Vision and Language☆584Dec 2, 2023Updated 2 years ago
- COYO-700M: Large-scale Image-Text Pair Dataset☆1,255Nov 30, 2022Updated 3 years ago
- [ICLR 2024] Analyzing and Mitigating Object Hallucination in Large Vision-Language Models☆159Apr 30, 2024Updated 2 years ago
- [ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videos☆128Sep 29, 2023Updated 2 years ago
- [CVPR 2023] Learning Visual Representations via Language-Guided Sampling☆150Apr 13, 2023Updated 3 years ago
- Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M d…☆219Aug 28, 2024Updated 2 years ago
- A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!☆140Dec 31, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence L…☆2,555Apr 24, 2024Updated 2 years ago
- An open source implementation of CLIP.☆14,170Updated this week
- [ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specific…☆85Sep 13, 2024Updated 2 years ago
- ☆231Dec 18, 2023Updated 2 years ago
- ☆20May 30, 2024Updated 2 years ago
- Teacher - student distillation using DeepSpeed☆20Oct 7, 2022Updated 3 years ago
- Trying to deconstruct RWKV in understandable terms☆14May 6, 2023Updated 3 years ago