Alternatives and similar repositories for flamingo-mini

Users that are interested in flamingo-mini are comparing it to the libraries listed below

• huggingface / OBELICS
  Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M d…
  ☆205Updated last year
• huggingface / m4-logs
  M4 experiment logbook
  ☆58Updated 2 years ago
• yxuansu / MAGIC
  Language Models Can See: Plugging Visual Controls in Text Generation
  ☆259Updated 3 years ago
• feizc / Visual-LLaMA
  Open LLaMA Eyes to See the World
  ☆174Updated 2 years ago
• microsoft / BridgeTower
  Open source code for AAAI 2023 Paper "BridgeTower: Building Bridges Between Encoders in Vision-Language Representation Learning"
  ☆166Updated 2 years ago
• sanjayss34 / codevqa
  ☆84Updated 2 years ago
• kohjingyu / fromage
  🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".
  ☆482Updated last year
• SALT-NLP / LLaVAR
  Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"
  ☆269Updated last year
• LAION-AI / General-GPT
  ☆65Updated last year
• rowanz / merlot_reserve
  Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"
  ☆143Updated 3 years ago
• PLUM-Lab / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆135Updated 2 years ago
• Vision-CAIR / VisualGPT
  VisualGPT, CVPR 2022 Proceeding, GPT as a decoder for vision-language models
  ☆338Updated 2 years ago
• ZrrSkywalker / LLaMA-Adapter
  Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
  ☆90Updated 2 years ago
• facebookresearch / diht
  Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training
  ☆138Updated 2 years ago
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆145Updated last week
• microsoft / FIBER
  Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
  ☆129Updated last year
• haoliuhl / language-quantized-autoencoders
  Language Quantized AutoEncoders
  ☆109Updated 2 years ago
• mshukor / UnIVAL
  [TMLR23] Official implementation of UnIVAL: Unified Model for Image, Video, Audio and Language Tasks.
  ☆229Updated last year
• OFA-Sys / TouchStone
  Touchstone: Evaluating Vision-Language Models by Language Models
  ☆83Updated last year
• nttmdlab-nlp / SlideVQA
  SlideVQA: A Dataset for Document Visual Question Answering on Multiple Images (AAAI2023)
  ☆94Updated 5 months ago
• allenai / unified-io-inference
  ☆228Updated last year
• TheoCoombes / ClipCap
  Using pretrained encoder and language models to generate captions from multimedia inputs.
  ☆98Updated 2 years ago
• DavidHuji / CapDec
  CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)
  ☆199Updated last year
• LAION-AI / Big-Interleaved-Dataset
  Big-Interleaved-Dataset
  ☆58Updated 2 years ago
• wade3han / champagne
  An official codebase for paper " CHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos (ICCV 23)"
  ☆52Updated 2 years ago
• j-min / VL-T5
  PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)
  ☆373Updated 2 years ago
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆206Updated 2 years ago
• gregor-ge / mBLIP
  ☆87Updated last year
• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆307Updated 7 months ago
• OFA-Sys / OFASys
  OFASys: A Multi-Modal Multi-Task Learning System for Building Generalist Models
  ☆152Updated 2 years ago