westlake-baichuan-mllm / bc-omni
Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊
☆266Updated 2 months ago
Alternatives and similar repositories for bc-omni:
Users that are interested in bc-omni are comparing it to the libraries listed below
- ☆145Updated 2 months ago
- [CVPR'25 highlight] RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthiness☆348Updated last month
- MMR1: Advancing the Frontiers of Multimodal Reasoning☆153Updated last month
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback☆276Updated 7 months ago
- ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM☆305Updated 3 months ago
- Long Context Transfer from Language to Vision☆371Updated last month
- [ICLR 2025 Spotlight] OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text☆338Updated 3 weeks ago
- Open-Qwen2VL: Compute-Efficient Pre-Training of Fully-Open Multimodal LLMs on Academic Resources☆155Updated 2 weeks ago
- Explore the Multimodal “Aha Moment” on 2B Model☆561Updated last month
- LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture☆201Updated 3 months ago
- ☆221Updated last month
- An easy-to-use, fast, and easily integrable tool for evaluating audio LLM☆78Updated 2 weeks ago
- This repo contains the code for "VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks" [ICLR25]☆193Updated last month
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆260Updated 9 months ago
- MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer☆221Updated last year
- R1-onevision, a visual language model capable of deep CoT reasoning.☆489Updated this week
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformer☆373Updated 2 weeks ago
- Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme☆102Updated last week
- ☆151Updated this week
- ☆169Updated 9 months ago
- ☆73Updated last year
- Efficient Multimodal Large Language Models: A Survey☆335Updated last month
- ☆265Updated 8 months ago
- MM-EUREKA: Exploring Visual Aha Moment with Rule-based Large-scale Reinforcement Learning☆518Updated this week
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*☆99Updated last month
- 🤗 R1-AQA Model: mispeech/r1-aqa☆230Updated 3 weeks ago
- The official repository for "2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining"☆151Updated last month
- [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Langua…☆407Updated 3 months ago
- [CVPR 2024 Highlight] OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allo…☆331Updated 7 months ago
- Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs☆158Updated last week