westlake-baichuan-mllm / bc-omni
Baichuan-Omni: Towards Capable Open-source Omni-modal LLM π
β260Updated 2 weeks ago
Alternatives and similar repositories for bc-omni:
Users that are interested in bc-omni are comparing it to the libraries listed below
- β¨β¨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLMβ270Updated last month
- RLAIF-V: Aligning MLLMs through Open-Source AI Feedback for Super GPT-4V Trustworthinessβ291Updated 2 months ago
- OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Textβ306Updated 2 months ago
- β203Updated 2 months ago
- LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architectureβ189Updated last month
- LongQLoRA: Extent Context Length of LLMs Efficientlyβ162Updated last year
- β309Updated last week
- Long Context Transfer from Language to Visionβ360Updated 2 months ago
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedbackβ264Updated 5 months ago
- An automated pipeline for evaluating LLMs for role-playing.β157Updated 5 months ago
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Feature Pyramid via Hierarchical Window Transformerβ364Updated last month
- The official repository for "2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining"β140Updated 3 weeks ago
- β73Updated 11 months ago
- MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizerβ210Updated 10 months ago
- β255Updated 6 months ago
- Valley is a cutting-edge multimodal large model designed to handle a variety of tasks involving text, images, and video data.β211Updated this week
- Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"β212Updated this week
- [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMsβ241Updated 2 months ago
- Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paperβ125Updated 6 months ago
- Repo for Benchmarking Multimodal Retrieval Augmented Generation with Dynamic VQA Dataset and Self-adaptive Planning Agentβ216Updated last week
- [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Surveyβ346Updated 3 weeks ago
- β168Updated last week
- [ACL2024] T-Eval: Evaluating Tool Utilization Capability of Large Language Models Step by Stepβ259Updated 10 months ago
- Efficient Multimodal Large Language Models: A Surveyβ312Updated 6 months ago
- β27Updated 5 months ago
- This repo contains the code for "VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks" [ICLR25]β135Updated this week
- A repository sharing the literatures about long-context large language models, including the methodologies and the evaluation benchmarksβ255Updated 6 months ago
- [ICML'24] Data and code for our paper "Training-Free Long-Context Scaling of Large Language Models"β389Updated 4 months ago