Alternatives and similar repositories for foundation-models

Users that are interested in foundation-models are comparing it to the libraries listed below

• lucidrains / MaMMUT-pytorch
  Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch
  ☆103Updated 2 years ago
• kirill-vish / Beyond-INet
  Code for experiments for "ConvNet vs Transformer, Supervised vs CLIP: Beyond ImageNet Accuracy"
  ☆102Updated last year
• lucidrains / AMIE-pytorch
  Implementation of the general framework for AMIE, from the paper "Towards Conversational Diagnostic AI", out of Google Deepmind
  ☆72Updated last year
• apple / ml-tic-clip
  Repository for the paper: "TiC-CLIP: Continual Training of CLIP Models" ICLR 2024
  ☆110Updated last year
• SriramB-98 / vit-decompose
  ☆23Updated last year
• lucidrains / zorro-pytorch
  Implementation of Zorro, Masked Multimodal Transformer, in Pytorch
  ☆98Updated 2 years ago
• facebookresearch / ViP-MAE
  This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision
  ☆36Updated 2 years ago
• facebookresearch / clip-rocket
  Code release for "Improved baselines for vision-language pre-training"
  ☆62Updated last year
• LAION-AI / General-GPT
  ☆65Updated 2 years ago
• TomerRonen34 / mixed-resolution-vit
  ☆56Updated 2 years ago
• bfshi / TOAST
  Official code for "TOAST: Transfer Learning via Attention Steering"
  ☆188Updated 2 years ago
• jonkahana / CLIPPR
  An official PyTorch implementation for CLIPPR
  ☆30Updated 2 years ago
• hammoudhasan / DiversitySSL
  Original code base for On Pretraining Data Diversity for Self-Supervised Learning
  ☆14Updated last year
• jacobmarks / awesome-neurips-2023
  Conference schedule, top papers, and analysis of the data for NeurIPS 2023!
  ☆120Updated 2 years ago
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆82Updated 2 years ago
• facebookresearch / RCDM
  Visualizing representations with diffusion based conditional generative model.
  ☆103Updated 2 years ago
• jeykigung / HiCLIP
  ☆30Updated 2 years ago
• bethgelab / frequency_determines_performance
  Code for the paper: "No Zero-Shot Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance" [NeurI…
  ☆94Updated last year
• ilkerkesen / ViLMA
  ViLMA: A Zero-Shot Benchmark for Linguistic and Temporal Grounding in Video-Language Models (ICLR 2024, Official Implementation)
  ☆16Updated 2 years ago
• rasbt / cvpr2023
  ☆133Updated 2 years ago
• lucidrains / mirasol-pytorch
  Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch
  ☆91Updated 2 years ago
• yueliukth / PatchDropout
  ☆19Updated 3 years ago
• k1rezaei / Text-to-concept
  ☆35Updated last year
• oripress / EntropyEnigma
  Official code for the ICML 2024 paper "The Entropy Enigma: Success and Failure of Entropy Minimization"
  ☆55Updated last year
• iancovert / locality-alignment
  ☆54Updated last year
• facebookresearch / maws
  Code and models for the paper "The effectiveness of MAE pre-pretraining for billion-scale pretraining" https://arxiv.org/abs/2303.13496
  ☆92Updated 9 months ago
• Optimization-AI / FastCLIP
  Distributed Optimization Infra for learning CLIP models
  ☆27Updated last year
• facebookresearch / imagenetx
  understanding model mistakes with human annotations
  ☆106Updated 2 years ago
• lucidrains / mixture-of-attention
  Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
  ☆122Updated last year
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆61Updated last year