Alternatives and similar repositories for MetaTransformer

Users that are interested in MetaTransformer are comparing it to the libraries listed below

• OFA-Sys / ONE-PEACE
  A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model To…
  ☆1,062Updated last year
• open-mmlab / Multimodal-GPT
  Multimodal-GPT
  ☆1,517Updated 2 years ago
• dvlab-research / LISA
  Project Page for "LISA: Reasoning Segmentation via Large Language Model"
  ☆2,523Updated 10 months ago
• baaivision / Emu
  Emu Series: Generative Multimodal Models from BAAI
  ☆1,761Updated last year
• Jamie-Stirling / RetNet
  An implementation of "Retentive Network: A Successor to Transformer for Large Language Models"
  ☆1,210Updated 2 years ago
• csuhan / OneLLM
  [CVPR 2024] OneLLM: One Framework to Align All Modalities with Language
  ☆665Updated last year
• facebookresearch / multimodal
  TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.
  ☆1,675Updated 2 weeks ago
• baaivision / EVA
  EVA Series: Visual Representation Fantasies from BAAI
  ☆2,620Updated last year
• OpenGVLab / VisionLLM
  VisionLLM Series
  ☆1,131Updated 9 months ago
• microsoft / X-Decoder
  [CVPR 2023] Official Implementation of X-Decoder for generalized decoding for pixel, image and language
  ☆1,337Updated 2 years ago
• ytongbai / LVM
  ☆1,838Updated last year
• PKU-YuanGroup / LanguageBind
  【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment
  ☆852Updated last year
• mlfoundations / open_flamingo
  An open-source framework for training large multimodal models.
  ☆4,050Updated last year
• facebookresearch / hiera
  Hiera: A fast, powerful, and simple hierarchical vision transformer.
  ☆1,044Updated last year
• Alpha-VLLM / LLaMA2-Accessory
  An Open-source Toolkit for LLM Development
  ☆2,794Updated 11 months ago
• microsoft / GLIP
  Grounded Language-Image Pre-training
  ☆2,553Updated last year
• facebookresearch / MetaCLIP
  NeurIPS 2025 Spotlight; ICLR2024 Spotlight; CVPR 2024; EMNLP 2024
  ☆1,770Updated 3 weeks ago
• shikras / shikra
  ☆800Updated last year
• baaivision / Painter
  Painter & SegGPT Series: Vision Foundation Models from BAAI
  ☆2,585Updated last year
• UX-Decoder / Semantic-SAM
  [ECCV 2024] Official implementation of the paper "Semantic-SAM: Segment and Recognize Anything at Any Granularity"
  ☆2,786Updated 5 months ago
• lucidrains / flamingo-pytorch
  Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
  ☆1,273Updated 3 years ago
• OptimalScale / DetGPT
  ☆789Updated last year
• OpenGVLab / InternVideo
  [ECCV2024] Video Foundation Models & Data for Multimodal Understanding
  ☆2,131Updated 2 weeks ago
• microsoft / i-Code
  ☆1,711Updated last year
• X-PLUG / mPLUG-Owl
  mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
  ☆2,537Updated 8 months ago
• ttengwang / Caption-Anything
  Caption-Anything is a versatile tool combining image segmentation, visual captioning, and ChatGPT, generating tailored captions with dive…
  ☆1,770Updated 2 years ago
• Ma-Lab-Berkeley / CRATE
  Code for CRATE (Coding RAte reduction TransformEr).
  ☆1,257Updated last year
• LLaVA-VL / LLaVA-Plus-Codebase
  LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
  ☆762Updated last year
• lucidrains / CoCa-pytorch
  Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch
  ☆1,188Updated 2 years ago
• PKU-YuanGroup / MoE-LLaVA
  【TMM 2025🔥】 Mixture-of-Experts for Large Vision-Language Models
  ☆2,283Updated 5 months ago