Alternatives and similar repositories for MetaTransformer

Users that are interested in MetaTransformer are comparing it to the libraries listed below

• open-mmlab / Multimodal-GPT
  Multimodal-GPT
  ☆1,509Updated 2 years ago
• OFA-Sys / ONE-PEACE
  A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model To…
  ☆1,052Updated 11 months ago
• Jamie-Stirling / RetNet
  An implementation of "Retentive Network: A Successor to Transformer for Large Language Models"
  ☆1,204Updated last year
• facebookresearch / multimodal
  TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.
  ☆1,648Updated last week
• PKU-YuanGroup / LanguageBind
  【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment
  ☆825Updated last year
• baaivision / Emu
  Emu Series: Generative Multimodal Models from BAAI
  ☆1,744Updated 11 months ago
• csuhan / OneLLM
  [CVPR 2024] OneLLM: One Framework to Align All Modalities with Language
  ☆653Updated 10 months ago
• OpenGVLab / VisionLLM
  VisionLLM Series
  ☆1,105Updated 6 months ago
• dvlab-research / LISA
  Project Page for "LISA: Reasoning Segmentation via Large Language Model"
  ☆2,395Updated 7 months ago
• Alpha-VLLM / LLaMA2-Accessory
  An Open-source Toolkit for LLM Development
  ☆2,790Updated 8 months ago
• ytongbai / LVM
  ☆1,831Updated last year
• baaivision / Painter
  Painter & SegGPT Series: Vision Foundation Models from BAAI
  ☆2,580Updated 9 months ago
• mlfoundations / open_flamingo
  An open-source framework for training large multimodal models.
  ☆4,005Updated last year
• facebookresearch / hiera
  Hiera: A fast, powerful, and simple hierarchical vision transformer.
  ☆1,022Updated last year
• baaivision / EVA
  EVA Series: Visual Representation Fantasies from BAAI
  ☆2,567Updated last year
• OpenGVLab / VideoMamba
  [ECCV2024] VideoMamba: State Space Model for Efficient Video Understanding
  ☆992Updated last year
• OptimalScale / DetGPT
  ☆785Updated last year
• allenai / visprog
  Official code for VisProg (CVPR 2023 Best Paper!)
  ☆744Updated last year
• Ma-Lab-Berkeley / CRATE
  Code for CRATE (Coding RAte reduction TransformEr).
  ☆1,241Updated 10 months ago
• microsoft / X-Decoder
  [CVPR 2023] Official Implementation of X-Decoder for generalized decoding for pixel, image and language
  ☆1,329Updated last year
• lucidrains / flamingo-pytorch
  Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
  ☆1,261Updated 2 years ago
• shikras / shikra
  ☆797Updated last year
• PKU-YuanGroup / MoE-LLaVA
  【TMM 2025🔥】 Mixture-of-Experts for Large Vision-Language Models
  ☆2,235Updated 2 months ago
• facebookresearch / MetaCLIP
  ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Expert…
  ☆1,675Updated 2 weeks ago
• Computer-Vision-in-the-Wild / CVinW_Readings
  A collection of papers on the topic of ``Computer Vision in the Wild (CVinW)''
  ☆1,328Updated last year
• OpenGVLab / InternVideo
  [ECCV2024] Video Foundation Models & Data for Multimodal Understanding
  ☆2,046Updated last month
• microsoft / GLIP
  Grounded Language-Image Pre-training
  ☆2,495Updated last year
• eric-ai-lab / MiniGPT-5
  Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"
  ☆860Updated 4 months ago
• test-time-training / ttt-lm-pytorch
  Official PyTorch implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States
  ☆1,252Updated last year
• OFA-Sys / OFA
  Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence L…
  ☆2,532Updated last year