SkalskiP / awesome-foundation-and-multimodal-models
👁️ + 💬 + 🎧 = 🤖 Curated list of top foundation and multimodal models! [Paper + Code + Examples + Tutorials]
☆596Updated 10 months ago
Alternatives and similar repositories for awesome-foundation-and-multimodal-models:
Users that are interested in awesome-foundation-and-multimodal-models are comparing it to the libraries listed below
- streamline the fine-tuning process for multimodal models: PaliGemma, Florence-2, and Qwen2-VL☆1,427Updated this week
- From scratch implementation of a vision language model in pure PyTorch☆189Updated 8 months ago
- Recipes for shrinking, optimizing, customizing cutting edge vision models. 💜☆1,093Updated 3 weeks ago
- This repository is a curated collection of the most exciting and influential CVPR 2024 papers. 🔥 [Paper + Code + Demo]☆685Updated 6 months ago
- ☆704Updated 10 months ago
- Quick exploration into fine tuning florence 2☆289Updated 3 months ago
- Famous Vision Language Models and Their Architectures☆565Updated 4 months ago
- ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Expert…☆1,337Updated last month
- ☆481Updated 2 months ago
- 4M: Massively Multimodal Masked Modeling☆1,666Updated 3 months ago
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆720Updated 11 months ago
- This repository provides the code and model checkpoints for AIMv1 and AIMv2 research projects.☆1,143Updated last month
- LLaVA-Interactive-Demo☆360Updated 5 months ago
- A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest…☆444Updated 2 months ago
- This is the official repository for the LENS (Large Language Models Enhanced to See) system.☆351Updated last year
- Grounding DINO 1.5: IDEA Research's Most Capable Open-World Object Detection Model Series☆853Updated 5 months ago
- Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"☆831Updated last month
- VisionLLM Series☆977Updated 2 weeks ago
- List of resources, libraries and more for developers who would like to build with open-source machine learning off-the-shelf☆199Updated 9 months ago
- DataComp: In search of the next generation of multimodal datasets☆674Updated last year
- [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses tha…☆814Updated last month
- PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"☆556Updated last year
- The official repo for the paper "VeCLIP: Improving CLIP Training via Visual-enriched Captions"☆238Updated 4 months ago
- Train Models Contrastively in Pytorch☆568Updated last week
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆224Updated 2 months ago
- A collection of papers on the topic of ``Computer Vision in the Wild (CVinW)''☆1,237Updated 10 months ago
- Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI☆1,358Updated 9 months ago
- LoRA and DoRA from Scratch Implementations☆194Updated 10 months ago
- Best practices for distilling large language models.☆424Updated 11 months ago