Alternatives and similar repositories for foundation-models

Users that are interested in foundation-models are comparing it to the libraries listed below

• kirill-vish / Beyond-INet
  Code for experiments for "ConvNet vs Transformer, Supervised vs CLIP: Beyond ImageNet Accuracy"
  ☆101Updated 10 months ago
• lucidrains / MaMMUT-pytorch
  Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch
  ☆103Updated last year
• iancovert / locality-alignment
  ☆51Updated 6 months ago
• apple / ml-tic-clip
  Repository for the paper: "TiC-CLIP: Continual Training of CLIP Models".
  ☆102Updated last year
• lucidrains / AMIE-pytorch
  Implementation of the general framework for AMIE, from the paper "Towards Conversational Diagnostic AI", out of Google Deepmind
  ☆66Updated 10 months ago
• bfshi / TOAST
  Official code for "TOAST: Transfer Learning via Attention Steering"
  ☆188Updated 2 years ago
• jeykigung / HiCLIP
  ☆29Updated 2 years ago
• facebookresearch / CiT
  Code for the paper titled "CiT Curation in Training for Effective Vision-Language Data".
  ☆78Updated 2 years ago
• jacobmarks / awesome-neurips-2023
  Conference schedule, top papers, and analysis of the data for NeurIPS 2023!
  ☆119Updated last year
• Optimization-AI / FastCLIP
  Distributed Optimization Infra for learning CLIP models
  ☆27Updated 10 months ago
• jonkahana / CLIPPR
  An official PyTorch implementation for CLIPPR
  ☆29Updated 2 years ago
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆57Updated 8 months ago
• lucidrains / zorro-pytorch
  Implementation of Zorro, Masked Multimodal Transformer, in Pytorch
  ☆97Updated last year
• facebookresearch / clip-rocket
  Code release for "Improved baselines for vision-language pre-training"
  ☆60Updated last year
• facebookresearch / ViP-MAE
  This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision
  ☆36Updated 2 years ago
• gregor-ge / mBLIP
  ☆86Updated last year
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆76Updated last year
• rasbt / cvpr2023
  ☆133Updated last year
• OscarXZQ / weight-selection
  ☆182Updated 10 months ago
• htqin / GoogleBard-VisUnderstand
  How Good is Google Bard's Visual Understanding? An Empirical Study on Open Challenges
  ☆30Updated last year
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆55Updated 11 months ago
• EPFL-VILAB / fm-vision-evals
  ☆68Updated 3 weeks ago
• ilkerkesen / ViLMA
  ViLMA: A Zero-Shot Benchmark for Linguistic and Temporal Grounding in Video-Language Models (ICLR 2024, Official Implementation)
  ☆16Updated last year
• LAION-AI / General-GPT
  ☆65Updated last year
• hammoudhasan / SynthCLIP
  Code base of SynthCLIP: CLIP training with purely synthetic text-image pairs from LLMs and TTIs.
  ☆100Updated 4 months ago
• facebookresearch / maws
  Code and models for the paper "The effectiveness of MAE pre-pretraining for billion-scale pretraining" https://arxiv.org/abs/2303.13496
  ☆91Updated 3 months ago
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆94Updated 7 months ago
• yueliukth / PatchDropout
  ☆19Updated 2 years ago
• bwconrad / soft-moe
  PyTorch implementation of "From Sparse to Soft Mixtures of Experts"
  ☆60Updated last year
• mlfoundations / patching
  Patching open-vocabulary models by interpolating weights
  ☆91Updated last year