Alternatives and similar repositories for foundation-models

Users that are interested in foundation-models are comparing it to the libraries listed below

• lucidrains / MaMMUT-pytorch
  Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch
  ☆103Updated last year
• kirill-vish / Beyond-INet
  Code for experiments for "ConvNet vs Transformer, Supervised vs CLIP: Beyond ImageNet Accuracy"
  ☆101Updated 11 months ago
• lucidrains / AMIE-pytorch
  Implementation of the general framework for AMIE, from the paper "Towards Conversational Diagnostic AI", out of Google Deepmind
  ☆67Updated 11 months ago
• jonkahana / CLIPPR
  An official PyTorch implementation for CLIPPR
  ☆29Updated 2 years ago
• LAION-AI / General-GPT
  ☆65Updated last year
• facebookresearch / CiT
  Code for the paper titled "CiT Curation in Training for Effective Vision-Language Data".
  ☆78Updated 2 years ago
• facebookresearch / clip-rocket
  Code release for "Improved baselines for vision-language pre-training"
  ☆60Updated last year
• apple / ml-tic-clip
  Repository for the paper: "TiC-CLIP: Continual Training of CLIP Models".
  ☆103Updated last year
• lucidrains / zorro-pytorch
  Implementation of Zorro, Masked Multimodal Transformer, in Pytorch
  ☆98Updated last year
• WalBouss / LeGrad
  [ICCV25] Official Implementation of LeGrad
  ☆78Updated 10 months ago
• bfshi / TOAST
  Official code for "TOAST: Transfer Learning via Attention Steering"
  ☆188Updated 2 years ago
• facebookresearch / maws
  Code and models for the paper "The effectiveness of MAE pre-pretraining for billion-scale pretraining" https://arxiv.org/abs/2303.13496
  ☆92Updated 4 months ago
• ilkerkesen / ViLMA
  ViLMA: A Zero-Shot Benchmark for Linguistic and Temporal Grounding in Video-Language Models (ICLR 2024, Official Implementation)
  ☆16Updated last year
• bethgelab / frequency_determines_performance
  Code for the paper: "No Zero-Shot Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance" [NeurI…
  ☆90Updated last year
• iancovert / locality-alignment
  ☆52Updated 7 months ago
• pliang279 / HEMM
  Holistic evaluation of multimodal foundation models
  ☆48Updated last year
• facebookresearch / ViP-MAE
  This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision
  ☆36Updated 2 years ago
• k1rezaei / Text-to-concept
  ☆34Updated last year
• hammoudhasan / DiversitySSL
  Original code base for On Pretraining Data Diversity for Self-Supervised Learning
  ☆14Updated 8 months ago
• yueliukth / PatchDropout
  ☆19Updated 2 years ago
• jacobmarks / awesome-neurips-2023
  Conference schedule, top papers, and analysis of the data for NeurIPS 2023!
  ☆120Updated last year
• facebookresearch / HierVL
  [CVPR 2023] HierVL Learning Hierarchical Video-Language Embeddings
  ☆46Updated 2 years ago
• mlfoundations / patching
  Patching open-vocabulary models by interpolating weights
  ☆91Updated last year
• facebookresearch / data2vec_vision
  Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
  ☆78Updated 3 years ago
• mbanani / lgssl
  [CVPR 2023] Learning Visual Representations via Language-Guided Sampling
  ☆148Updated 2 years ago
• rasbt / cvpr2023
  ☆134Updated last year
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆77Updated last year
• lucidrains / mirasol-pytorch
  Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch
  ☆89Updated last year
• Guillem96 / data2vec-vision
  PyTorch implementation of Data2Vec self-supervised approach for vision use cases.
  ☆18Updated 2 years ago
• facebookresearch / RCDM
  Visualizing representations with diffusion based conditional generative model.
  ☆97Updated 2 years ago