SkalskiP / awesome-foundation-and-multimodal-modelsLinks
ποΈ + π¬ + π§ = π€ Curated list of top foundation and multimodal models! [Paper + Code + Examples + Tutorials]
β636Updated last year
Alternatives and similar repositories for awesome-foundation-and-multimodal-models
Users that are interested in awesome-foundation-and-multimodal-models are comparing it to the libraries listed below
Sorting:
- This repository is a curated collection of the most exciting and influential CVPR 2024 papers. π₯ [Paper + Code + Demo]β741Updated 4 months ago
- Recipes for shrinking, optimizing, customizing cutting edge vision models. πβ1,642Updated last month
- From scratch implementation of a vision language model in pure PyTorchβ244Updated last year
- β714Updated last year
- List of resources, libraries and more for developers who would like to build with open-source machine learning off-the-shelfβ198Updated last year
- Quick exploration into fine tuning florence 2β334Updated last year
- β227Updated last year
- streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VLβ2,641Updated this week
- A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplestβ¦β458Updated 2 weeks ago
- This is the official repository for the LENS (Large Language Models Enhanced to See) system.β354Updated 3 months ago
- This repository is a curated collection of the most exciting and influential CVPR 2023 papers. π₯ [Paper + Code]β653Updated 4 months ago
- AI assistant that can query visual datasets, search the FiftyOne docs, and answer general computer vision questionsβ248Updated 10 months ago
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skillsβ758Updated last year
- LoRA and DoRA from Scratch Implementationsβ211Updated last year
- This repo is the homebase of a community driven course on Computer Vision with Neural Networks. Feel free to join us on the Hugging Face β¦β723Updated last month
- 4M: Massively Multimodal Masked Modelingβ1,764Updated 4 months ago
- This repository provides the code and model checkpoints for AIMv1 and AIMv2 research projects.β1,377Updated 2 months ago
- PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"β681Updated last year
- ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Expertβ¦β1,694Updated 3 weeks ago
- β446Updated last year
- Projects based on SigLIP (Zhai et. al, 2023) and Hugging Face transformers integration π€β277Updated 8 months ago
- Toolkit for attaching, training, saving and loading of new heads for transformer modelsβ289Updated 7 months ago
- Famous Vision Language Models and Their Architecturesβ1,041Updated 8 months ago
- All the projects related to Llamaβ379Updated 6 months ago
- Notebooks for fine tuning pali gemmaβ117Updated 6 months ago
- Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 linesβ195Updated last year
- The official repo for the paper "VeCLIP: Improving CLIP Training via Visual-enriched Captions"β246Updated 9 months ago
- β587Updated 2 years ago
- [CVPR 2024 π₯] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses thaβ¦β922Updated 2 months ago
- A curated list of papers that released datasets along with their workβ126Updated last year