OpenMOSS / AnyGPT
Code for "AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling"
☆832Updated 7 months ago
Alternatives and similar repositories for AnyGPT:
Users that are interested in AnyGPT are comparing it to the libraries listed below
- SpeechGPT Series: Speech Large Language Models☆1,356Updated 8 months ago
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆733Updated last year
- The official repo of Qwen-Audio (通义千问-Audio) chat & pretrained large audio language model proposed by Alibaba Cloud.☆1,646Updated 8 months ago
- [CVPR 2024] OneLLM: One Framework to Align All Modalities with Language☆624Updated 5 months ago
- A family of lightweight multimodal models.☆1,006Updated 4 months ago
- Next-Token Prediction is All You Need☆2,042Updated last week
- HPT - Open Multimodal LLMs from HyperGAI☆314Updated 9 months ago
- ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM☆294Updated 2 months ago
- Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration☆1,560Updated 2 months ago
- A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.☆838Updated last month
- Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation☆733Updated 7 months ago
- Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"☆864Updated 3 months ago
- Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊☆265Updated 2 months ago
- ☆743Updated this week
- BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs☆508Updated last year
- SALMONN: Speech Audio Language Music Open Neural Network☆1,188Updated 3 weeks ago
- ✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models☆633Updated 3 months ago
- ☆377Updated 3 months ago
- This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for E…☆404Updated 2 weeks ago
- LLaVA-Interactive-Demo☆367Updated 8 months ago
- VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs☆1,124Updated 2 months ago
- Mixture-of-Experts for Large Vision-Language Models☆2,127Updated 3 months ago
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformer☆370Updated last week
- Codebase for Aria - an Open Multimodal Native MoE☆1,029Updated 2 months ago
- ☆603Updated last year
- LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)☆783Updated 7 months ago
- InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions☆2,791Updated 2 months ago
- [ACL 2024] Progressive LLaMA with Block Expansion.☆499Updated 10 months ago
- Emu Series: Generative Multimodal Models from BAAI☆1,695Updated 6 months ago
- Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding☆603Updated 3 months ago