Callione / LLaVA-MOSS2
Modified LLaVA framework for MOSS2, and makes MOSS2 a multimodal model.
☆13Updated 3 months ago
Alternatives and similar repositories for LLaVA-MOSS2:
Users that are interested in LLaVA-MOSS2 are comparing it to the libraries listed below
- ☆36Updated 2 weeks ago
- Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey☆274Updated this week
- Explore the Limits of Omni-modal Pretraining at Scale☆96Updated 4 months ago
- 🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".☆222Updated 3 weeks ago
- This repository contains the code for SFT, RLHF, and DPO, designed for vision-based LLMs, including the LLaVA models and the LLaMA-3.2-vi…☆96Updated 3 months ago
- The official code of the paper "Deciphering Cross-Modal Alignment in Large Vision-Language Models with Modality Integration Rate".☆92Updated last month
- ☆91Updated 6 months ago
- Visualizing the attention of vision-language models☆95Updated 2 months ago
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models☆235Updated last week
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback☆257Updated 4 months ago
- [ECCV 2024] Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMs☆90Updated 2 months ago
- Efficient Multimodal Large Language Models: A Survey☆304Updated 5 months ago
- A curated list of awesome Multimodal studies.☆122Updated this week
- [CVPR 2024 Highlight] OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allo…☆302Updated 4 months ago
- LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models☆109Updated 8 months ago
- [NeurIPS2024] Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'☆136Updated this week
- VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models☆40Updated 6 months ago
- Official implementation of paper 'Look Twice Before You Answer: Memory-Space Visual Retracing for Hallucination Mitigation in Multimodal …☆38Updated last month
- A RLHF Infrastructure for Vision-Language Models☆145Updated 2 months ago
- ☆57Updated 7 months ago
- 📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.☆328Updated 3 weeks ago
- [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment☆56Updated 3 months ago
- Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊☆258Updated 2 months ago
- VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".☆91Updated 6 months ago
- Visual Instruction Tuning for Qwen2 Base Model☆21Updated 6 months ago
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆251Updated 6 months ago
- [EMNLP 2024 Findings🔥] Official implementation of "LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Infe…☆88Updated 2 months ago
- code for "Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization"☆51Updated 4 months ago
- ☆26Updated 2 months ago
- ☆38Updated 6 months ago