westlake-baichuan-mllm / bc-omni
Baichuan-Omni: Towards Capable Open-source Omni-modal LLM π
β267Updated 3 months ago
Alternatives and similar repositories for bc-omni:
Users that are interested in bc-omni are comparing it to the libraries listed below
- β150Updated 3 months ago
- [CVPR'25 highlight] RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthinessβ358Updated 2 months ago
- MMR1: Advancing the Frontiers of Multimodal Reasoningβ159Updated last month
- β¨β¨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLMβ314Updated 4 months ago
- Long Context Transfer from Language to Visionβ374Updated last month
- β225Updated 2 months ago
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Modelβ261Updated 10 months ago
- LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architectureβ201Updated 4 months ago
- [ICLR 2025 Spotlight] OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Textβ343Updated last month
- Open-Qwen2VL: Compute-Efficient Pre-Training of Fully-Open Multimodal LLMs on Academic Resourcesβ190Updated last month
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedbackβ276Updated 7 months ago
- Explore the Multimodal βAha Momentβ on 2B Modelβ583Updated last month
- Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Schemeβ120Updated last month
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformerβ376Updated 2 weeks ago
- The official repository for "2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining"β152Updated last month
- This repo contains the code for "VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks" [ICLR25]β211Updated last month
- The Next Step Forward in Multimodal LLM Alignmentβ149Updated last week
- CPPO: Accelerating the Training of Group Relative Policy Optimization-Based Reasoning Modelsβ123Updated this week
- Explore the Limits of Omni-modal Pretraining at Scaleβ97Updated 8 months ago
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*β100Updated 2 months ago
- β73Updated last year
- [ICLR2025] LLaVA-HR: High-Resolution Large Language-Vision Assistantβ237Updated 8 months ago
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability ofβ¦β116Updated 5 months ago
- MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizerβ223Updated last year
- MM-EUREKA: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learningβ590Updated this week
- β183Updated 3 weeks ago
- R1-onevision, a visual language model capable of deep CoT reasoning.β513Updated 3 weeks ago
- A Token-level Text Image Foundation Model for Document Understandingβ91Updated this week
- β188Updated 10 months ago
- An easy-to-use, fast, and easily integrable tool for evaluating audio LLMβ91Updated 3 weeks ago