2U1 / Phi3-Vision-Finetune
An open-source implementaion for fine-tuning Phi3-Vision and Phi3.5-Vision by Microsoft.
☆92Updated last week
Alternatives and similar repositories for Phi3-Vision-Finetune:
Users that are interested in Phi3-Vision-Finetune are comparing it to the libraries listed below
- E5-V: Universal Embeddings with Multimodal Large Language Models☆246Updated 4 months ago
- Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.☆58Updated 10 months ago
- An open-source implementaion for fine-tuning Llama3.2-Vision series by Meta.☆155Updated last week
- [ECCV 2024] Official PyTorch implementation code for realizing the technical part of Mixture of All Intelligence (MoAI) to improve perfor…☆323Updated last year
- [EMNLP 2024] Official PyTorch implementation code for realizing the technical part of Traversal of Layers (TroL) presenting new propagati…☆96Updated 10 months ago
- [NeurIPS 2024] Official PyTorch implementation code for realizing the technical part of Mamba-based traversal of rationale (Meteor) to im…☆114Updated 11 months ago
- [ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specific…☆68Updated 7 months ago
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformer☆376Updated 2 weeks ago
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆319Updated 9 months ago
- [Fully open] [Encoder-free MLLM] Vision as LoRA☆146Updated 2 weeks ago
- An open-source implementaion for fine-tuning Molmo-7B-D and Molmo-7B-O by allenai.☆54Updated last week
- a family of highly capabale yet efficient large multimodal models☆179Updated 8 months ago
- [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context☆154Updated 7 months ago
- [ICLR2025] LLaVA-HR: High-Resolution Large Language-Vision Assistant☆237Updated 8 months ago
- LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.☆508Updated last month
- [ACL 2024 Findings] Official PyTorch Implementation code for realizing the technical part of CoLLaVO: Crayon Large Language and Vision mO…☆96Updated 10 months ago
- Rethinking Step-by-step Visual Reasoning in LLMs☆292Updated 3 months ago
- 1-Click is all you need.☆61Updated last year
- LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture☆201Updated 4 months ago
- 구글에서 발표한 Chain-of-Thought Reasoning without Prompting을 코드로 구현한 레포입니다.☆65Updated 7 months ago
- MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning☆357Updated 8 months ago
- Matryoshka Multimodal Models☆101Updated 3 months ago
- This repo contains the code for "VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks" [ICLR25]☆204Updated last month
- LLaVA-MORE: A Comparative Study of LLMs and Visual Backbones for Enhanced Visual Instruction Tuning☆133Updated last week
- Code for ChatRex: Taming Multimodal LLM for Joint Perception and Understanding☆182Updated 3 months ago
- On Efficient Language and Vision Assistants for Visually-Situated Natural Language Understanding: What Matters in Reading and Reasoning, …☆16Updated 4 months ago
- ☆174Updated 6 months ago
- Quick exploration into fine tuning florence 2☆309Updated 7 months ago
- ☆60Updated 2 months ago
- CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts☆147Updated 10 months ago