2U1 / Molmo-Finetune
An open-source implementaion for fine-tuning Molmo-7B-D and Molmo-7B-O by allenai.
☆42Updated last week
Alternatives and similar repositories for Molmo-Finetune:
Users that are interested in Molmo-Finetune are comparing it to the libraries listed below
- ☆159Updated 6 months ago
- [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context☆141Updated 3 months ago
- Code for ChatRex: Taming Multimodal LLM for Joint Perception and Understanding☆124Updated last month
- Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models☆56Updated 2 months ago
- Official code implementation of Slow Perception:Let's Perceive Geometric Figures Step-by-step☆80Updated last week
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆109Updated last month
- ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models☆147Updated 3 weeks ago
- Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"☆143Updated this week
- ☆73Updated 10 months ago
- a family of highly capabale yet efficient large multimodal models☆176Updated 4 months ago
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*☆77Updated last week
- Multimodal Open-O1 (MO1) is designed to enhance the accuracy of inference models by utilizing a novel prompt-based approach. This tool wo…☆28Updated 3 months ago
- ☆28Updated last month
- MLLM-DataEngine: An Iterative Refinement Approach for MLLM☆42Updated 7 months ago
- [COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs☆133Updated 4 months ago
- Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want☆63Updated 3 months ago
- E5-V: Universal Embeddings with Multimodal Large Language Models☆216Updated 3 weeks ago
- LLaVA-HR: High-Resolution Large Language-Vision Assistant☆223Updated 5 months ago
- ☆132Updated last year
- An open-source implementaion for fine-tuning Qwen2-VL series by Alibaba Cloud.☆170Updated this week
- The official repository for "2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining"☆118Updated this week
- Matryoshka Multimodal Models☆90Updated 2 months ago
- VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".☆91Updated 6 months ago
- The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.☆79Updated last month
- Official repo of Griffon series including v1(ECCV 2024), v2, and G☆127Updated last week
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆252Updated 6 months ago
- Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment☆38Updated 2 weeks ago
- ☆59Updated 11 months ago
- Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs☆70Updated 2 months ago