2U1 / Phi3-Vision-Finetune
An open-source implementaion for fine-tuning Phi3-Vision and Phi3.5-Vision by Microsoft.
☆88Updated 3 weeks ago
Alternatives and similar repositories for Phi3-Vision-Finetune:
Users that are interested in Phi3-Vision-Finetune are comparing it to the libraries listed below
- [ECCV 2024] Official PyTorch implementation code for realizing the technical part of Mixture of All Intelligence (MoAI) to improve perfor…☆318Updated 11 months ago
- An open-source implementaion for fine-tuning Llama3.2-Vision series by Meta.☆139Updated 2 weeks ago
- Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.☆58Updated 8 months ago
- [EMNLP 2024] Official PyTorch implementation code for realizing the technical part of Traversal of Layers (TroL) presenting new propagati…☆92Updated 8 months ago
- E5-V: Universal Embeddings with Multimodal Large Language Models☆234Updated 2 months ago
- [NeurIPS 2024] Official PyTorch implementation code for realizing the technical part of Mamba-based traversal of rationale (Meteor) to im…☆109Updated 9 months ago
- MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning☆352Updated 7 months ago
- [ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specific…☆65Updated 6 months ago
- [ACL 2024 Findings] Official PyTorch Implementation code for realizing the technical part of CoLLaVO: Crayon Large Language and Vision mO…☆95Updated 8 months ago
- a family of highly capabale yet efficient large multimodal models☆177Updated 6 months ago
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆315Updated 7 months ago
- The Universe of Evaluation. All about the evaluation for LLMs.☆222Updated 8 months ago
- An open-source implementaion for fine-tuning Molmo-7B-D and Molmo-7B-O by allenai.☆52Updated last month
- This is the repo for the paper "PANGEA: A FULLY OPEN MULTILINGUAL MULTIMODAL LLM FOR 39 LANGUAGES"☆104Updated 3 months ago
- [ECCV'24 Workshops Oral] DALDA: Data Augmentation Leveraging Diffusion Model and LLM with Adaptive Guidance Scaling☆29Updated 4 months ago
- [ICLR2025] LLaVA-HR: High-Resolution Large Language-Vision Assistant☆235Updated 7 months ago
- Quick exploration into fine tuning florence 2☆303Updated 5 months ago
- Rethinking Step-by-step Visual Reasoning in LLMs☆268Updated last month
- CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts☆143Updated 9 months ago
- A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.☆89Updated 2 months ago
- Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"☆145Updated last month
- On Efficient Language and Vision Assistants for Visually-Situated Natural Language Understanding: What Matters in Reading and Reasoning, …☆16Updated 2 months ago
- 1-Click is all you need.☆59Updated 10 months ago
- A real-time, high-frequency, real-world desktop environment that is suitable for desktop-based ML development (agents, world models, etc.…☆12Updated last month
- [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context☆147Updated 5 months ago
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Feature Pyramid via Hierarchical Window Transformer☆369Updated 2 months ago
- Python Library to evaluate VLM models' robustness across diverse benchmarks☆194Updated last week
- An open-source implementaion for fine-tuning Qwen2-VL and Qwen2.5-VL series by Alibaba Cloud.☆431Updated last week
- (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…☆84Updated 3 weeks ago