Alternatives and similar repositories for flamingo-mini

Users that are interested in flamingo-mini are comparing it to the libraries listed below

• huggingface / OBELICS
  Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M d…
  ☆207Updated 11 months ago
• microsoft / BridgeTower
  Open source code for AAAI 2023 Paper "BridgeTower: Building Bridges Between Encoders in Vision-Language Representation Learning"
  ☆166Updated 2 years ago
• huggingface / m4-logs
  M4 experiment logbook
  ☆58Updated 2 years ago
• yxuansu / MAGIC
  Language Models Can See: Plugging Visual Controls in Text Generation
  ☆258Updated 3 years ago
• feizc / Visual-LLaMA
  Open LLaMA Eyes to See the World
  ☆174Updated 2 years ago
• microsoft / FIBER
  Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
  ☆129Updated last year
• kohjingyu / fromage
  🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".
  ☆482Updated last year
• LAION-AI / General-GPT
  ☆65Updated last year
• sanjayss34 / codevqa
  ☆84Updated 2 years ago
• SALT-NLP / LLaVAR
  Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"
  ☆269Updated last year
• LAION-AI / Big-Interleaved-Dataset
  Big-Interleaved-Dataset
  ☆58Updated 2 years ago
• facebookresearch / diht
  Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training
  ☆138Updated 2 years ago
• allenai / unified-io-inference
  ☆228Updated last year
• ZrrSkywalker / LLaMA-Adapter
  Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
  ☆90Updated 2 years ago
• rowanz / merlot_reserve
  Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"
  ☆143Updated 3 years ago
• DavidHuji / CapDec
  CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)
  ☆198Updated last year
• kyegomez / PALI
  Democratization of "PaLI: A Jointly-Scaled Multilingual Language-Image Model"
  ☆92Updated last year
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆145Updated last week
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆205Updated 2 years ago
• PLUM-Lab / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆135Updated 2 years ago
• OFA-Sys / TouchStone
  Touchstone: Evaluating Vision-Language Models by Language Models
  ☆83Updated last year
• haoliuhl / language-quantized-autoencoders
  Language Quantized AutoEncoders
  ☆109Updated 2 years ago
• LAION-AI / scaling-laws-openclip
  Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)
  ☆172Updated 2 months ago
• nttmdlab-nlp / SlideVQA
  SlideVQA: A Dataset for Document Visual Question Answering on Multiple Images (AAAI2023)
  ☆92Updated 4 months ago
• Vision-CAIR / VisualGPT
  VisualGPT, CVPR 2022 Proceeding, GPT as a decoder for vision-language models
  ☆336Updated 2 years ago
• gregor-ge / mBLIP
  ☆86Updated last year
• bjoernpl / KOSMOS_reimplementation
  A reimplementation of KOSMOS-1 from "Language Is Not All You Need: Aligning Perception with Language Models"
  ☆27Updated 2 years ago
• wade3han / champagne
  An official codebase for paper " CHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos (ICCV 23)"
  ☆52Updated 2 years ago
• TheoCoombes / ClipCap
  Using pretrained encoder and language models to generate captions from multimedia inputs.
  ☆97Updated 2 years ago
• TIGER-AI-Lab / UniIR
  Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)
  ☆159Updated 10 months ago