2U1 / Phi3-Vision-Finetune
An open-source implementaion for fine-tuning Phi3-Vision and Phi3.5-Vision by Microsoft.
☆85Updated this week
Alternatives and similar repositories for Phi3-Vision-Finetune:
Users that are interested in Phi3-Vision-Finetune are comparing it to the libraries listed below
- Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.☆57Updated 8 months ago
- [EMNLP 2024] Official PyTorch implementation code for realizing the technical part of Traversal of Layers (TroL) presenting new propagati…☆89Updated 7 months ago
- An open-source implementaion for fine-tuning Llama3.2-Vision series by Meta.☆130Updated this week
- E5-V: Universal Embeddings with Multimodal Large Language Models☆233Updated last month
- a family of highly capabale yet efficient large multimodal models☆176Updated 5 months ago
- MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning☆351Updated 6 months ago
- [ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specific…☆65Updated 5 months ago
- An open-source implementaion for fine-tuning Molmo-7B-D and Molmo-7B-O by allenai.☆47Updated 3 weeks ago
- Quick exploration into fine tuning florence 2☆299Updated 5 months ago
- [NeurIPS 2024] Official PyTorch implementation code for realizing the technical part of Mamba-based traversal of rationale (Meteor) to im…☆108Updated 8 months ago
- An open-source implementaion for fine-tuning Qwen2-VL and Qwen2.5-VL series by Alibaba Cloud.☆305Updated this week
- LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.☆470Updated last month
- [ICLR2025] LLaVA-HR: High-Resolution Large Language-Vision Assistant☆229Updated 6 months ago
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Feature Pyramid via Hierarchical Window Transformer☆366Updated last month
- ☆320Updated last week
- Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"☆145Updated 3 weeks ago
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆313Updated 7 months ago
- The official repo for the paper "VeCLIP: Improving CLIP Training via Visual-enriched Captions"☆239Updated 3 weeks ago
- Code for the Molmo Vision-Language Model☆292Updated 2 months ago
- Code for ChatRex: Taming Multimodal LLM for Joint Perception and Understanding☆151Updated 3 weeks ago
- CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts☆141Updated 8 months ago
- LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture☆190Updated last month
- (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…☆82Updated this week
- [ECCV 2024] Official PyTorch implementation code for realizing the technical part of Mixture of All Intelligence (MoAI) to improve perfor…☆318Updated 10 months ago
- [ACL 2024 Findings] Official PyTorch Implementation code for realizing the technical part of CoLLaVO: Crayon Large Language and Vision mO…☆95Updated 7 months ago
- A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.☆89Updated 2 months ago
- This is the repo for the paper "PANGEA: A FULLY OPEN MULTILINGUAL MULTIMODAL LLM FOR 39 LANGUAGES"☆102Updated 2 months ago
- When do we not need larger vision models?☆368Updated last week
- This repo contains the code for "VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks" [ICLR25]☆142Updated last week
- Matryoshka Multimodal Models☆97Updated 3 weeks ago