SkalskiP / awesome-foundation-and-multimodal-modelsLinks
👁️ + 💬 + 🎧 = 🤖 Curated list of top foundation and multimodal models! [Paper + Code + Examples + Tutorials]
☆624Updated last year
Alternatives and similar repositories for awesome-foundation-and-multimodal-models
Users that are interested in awesome-foundation-and-multimodal-models are comparing it to the libraries listed below
Sorting:
- From scratch implementation of a vision language model in pure PyTorch☆227Updated last year
- Recipes for shrinking, optimizing, customizing cutting edge vision models. 💜☆1,520Updated this week
- ☆710Updated last year
- This repository is a curated collection of the most exciting and influential CVPR 2024 papers. 🔥 [Paper + Code + Demo]☆732Updated last month
- A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest…☆453Updated last month
- List of resources, libraries and more for developers who would like to build with open-source machine learning off-the-shelf☆198Updated last year
- This repo is the homebase of a community driven course on Computer Vision with Neural Networks. Feel free to join us on the Hugging Face …☆663Updated this week
- streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL☆2,592Updated this week
- AI assistant that can query visual datasets, search the FiftyOne docs, and answer general computer vision questions☆246Updated 7 months ago
- Quick exploration into fine tuning florence 2☆322Updated 9 months ago
- This repository is a curated collection of the most exciting and influential CVPR 2023 papers. 🔥 [Paper + Code]☆653Updated last month
- 4M: Massively Multimodal Masked Modeling☆1,742Updated last month
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆749Updated last year
- ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Expert…☆1,474Updated this week
- This is the official repository for the LENS (Large Language Models Enhanced to See) system.☆352Updated last year
- Projects based on SigLIP (Zhai et. al, 2023) and Hugging Face transformers integration 🤗☆256Updated 4 months ago
- ☆223Updated last year
- PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"☆644Updated last year
- Famous Vision Language Models and Their Architectures☆908Updated 4 months ago
- Toolkit for attaching, training, saving and loading of new heads for transformer models☆282Updated 4 months ago
- The official repo for the paper "VeCLIP: Improving CLIP Training via Visual-enriched Captions"☆244Updated 5 months ago
- This repository provides the code and model checkpoints for AIMv1 and AIMv2 research projects.☆1,323Updated 2 months ago
- ☆447Updated last year
- Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻🍳☆315Updated last month
- LoRA and DoRA from Scratch Implementations☆206Updated last year
- Place where folks can contribute to 🤗 community events☆424Updated last year
- All the projects related to Llama☆380Updated 3 months ago
- Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines☆197Updated last year
- Each week I create sketches covering key Computer Vision concepts. If you want to learn more about CV stick around!☆147Updated 2 years ago
- Automatically evaluate your LLMs in Google Colab☆649Updated last year