SkalskiP / awesome-foundation-and-multimodal-models
👁️ + 💬 + 🎧 = 🤖 Curated list of top foundation and multimodal models! [Paper + Code + Examples + Tutorials]
☆577Updated 8 months ago
Related projects ⓘ
Alternatives and complementary repositories for awesome-foundation-and-multimodal-models
- streamline the fine-tuning process for multimodal models: PaliGemma, Florence-2, and Qwen2-VL☆1,390Updated this week
- Recipes for shrinking, optimizing, customizing cutting edge vision models. 💜☆890Updated 2 months ago
- This repository is a curated collection of the most exciting and influential CVPR 2024 papers. 🔥 [Paper + Code + Demo]☆664Updated 4 months ago
- From scratch implementation of a vision language model in pure PyTorch☆162Updated 6 months ago
- Famous Vision Language Models and Their Architectures☆423Updated 2 months ago
- PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"☆526Updated 10 months ago
- Quick exploration into fine tuning florence 2☆271Updated 2 months ago
- ☆700Updated 8 months ago
- A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest…☆438Updated last week
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆705Updated 9 months ago
- ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Expert…☆1,255Updated this week
- System 2 Reasoning Link Collection☆693Updated 3 weeks ago
- LLaVA-Interactive-Demo☆352Updated 3 months ago
- VisionLLM Series☆924Updated last month
- This is the official repository for the LENS (Large Language Models Enhanced to See) system.☆351Updated 11 months ago
- Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"☆803Updated 3 months ago
- 4M: Massively Multimodal Masked Modeling☆1,607Updated last month
- LoRA and DoRA from Scratch Implementations☆188Updated 8 months ago
- A family of lightweight multimodal models.☆933Updated this week
- Fine-tune mistral-7B on 3090s, a100s, h100s☆702Updated last year
- Framework agnostic computer vision inference. Run 1000+ models by changing only one line of code. Supports models from transformers, timm…☆119Updated this week
- [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses tha…☆782Updated 5 months ago
- The official repo for the paper "VeCLIP: Improving CLIP Training via Visual-enriched Captions"☆228Updated 2 months ago
- Everything you need to know about Transformers! 🤖☆127Updated last year
- Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing imag…☆466Updated 7 months ago
- This repo is the homebase of a community driven course on Computer Vision with Neural Networks. Feel free to join us on the Hugging Face …☆488Updated last week
- Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI☆1,336Updated 7 months ago
- ☆763Updated this week
- Best practices & guides on how to write distributed pytorch training code☆286Updated 2 weeks ago
- Hiera: A fast, powerful, and simple hierarchical vision transformer.☆896Updated 8 months ago