2U1 / Phi3-Vision-FinetuneLinks
An open-source implementaion for fine-tuning Phi3-Vision and Phi3.5-Vision by Microsoft.
☆95Updated last month
Alternatives and similar repositories for Phi3-Vision-Finetune
Users that are interested in Phi3-Vision-Finetune are comparing it to the libraries listed below
Sorting:
- Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.☆58Updated 11 months ago
- [ECCV 2024] Official PyTorch implementation code for realizing the technical part of Mixture of All Intelligence (MoAI) to improve perfor…☆323Updated last year
- An open-source implementaion for fine-tuning Molmo-7B-D and Molmo-7B-O by allenai.☆55Updated last month
- An open-source implementaion for fine-tuning Llama3.2-Vision series by Meta.☆164Updated 2 weeks ago
- [EMNLP 2024] Official PyTorch implementation code for realizing the technical part of Traversal of Layers (TroL) presenting new propagati…☆97Updated 11 months ago
- [NeurIPS 2024] Official PyTorch implementation code for realizing the technical part of Mamba-based traversal of rationale (Meteor) to im…☆114Updated last year
- [ACL 2024 Findings] Official PyTorch Implementation code for realizing the technical part of CoLLaVO: Crayon Large Language and Vision mO…☆96Updated 11 months ago
- E5-V: Universal Embeddings with Multimodal Large Language Models☆249Updated 5 months ago
- MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning☆356Updated 9 months ago
- OpenVision: A Fully-Open, Cost-Effective Family of Advanced Vision Encoders for Multimodal Learning☆237Updated 3 weeks ago
- [ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specific…☆71Updated 8 months ago
- a family of highly capabale yet efficient large multimodal models☆183Updated 9 months ago
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆321Updated 10 months ago
- [Fully open] [Encoder-free MLLM] Vision as LoRA☆280Updated last week
- A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.☆92Updated 5 months ago
- Quick exploration into fine tuning florence 2☆316Updated 8 months ago
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformer☆379Updated last month
- LLaVA-MORE: A Comparative Study of LLMs and Visual Backbones for Enhanced Visual Instruction Tuning☆138Updated last month
- ☆362Updated 3 months ago
- Fine-tuning Qwen2.5-VL for vision-language tasks | Optimized for Vision understanding | LoRA & PEFT support.☆72Updated 3 months ago
- [ACL 2025 🔥] Rethinking Step-by-step Visual Reasoning in LLMs☆299Updated 2 weeks ago
- An open-source implementaion for fine-tuning SmolVLM.☆32Updated last month
- The Universe of Evaluation. All about the evaluation for LLMs.☆224Updated 10 months ago
- A lightweight adjustment tool for smoothing token probabilities in the Qwen models to encourage balanced multilingual generation.☆72Updated last month
- This is the repo for the paper "PANGEA: A FULLY OPEN MULTILINGUAL MULTIMODAL LLM FOR 39 LANGUAGES"☆105Updated 6 months ago
- Pretraining and finetuning for visual instruction following with Mixture of Experts☆15Updated last year
- (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…☆83Updated 3 months ago
- LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture☆203Updated 5 months ago
- From scratch implementation of a vision language model in pure PyTorch☆220Updated last year
- This project is a collection of fine-tuning scripts to help researchers fine-tune Qwen 2 VL on HuggingFace datasets.☆69Updated 8 months ago