OpenMOSS / AnyGPTLinks
Code for "AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling"
☆855Updated 11 months ago
Alternatives and similar repositories for AnyGPT
Users that are interested in AnyGPT are comparing it to the libraries listed below
Sorting:
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆752Updated last year
- SALMONN family: A suite of advanced multi-modal LLMs☆1,289Updated 3 weeks ago
- SpeechGPT Series: Speech Large Language Models☆1,385Updated last year
- [CVPR 2024] OneLLM: One Framework to Align All Modalities with Language☆651Updated 9 months ago
- HPT - Open Multimodal LLMs from HyperGAI☆315Updated last year
- Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"☆861Updated 2 months ago
- Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation☆776Updated last month
- Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊☆267Updated 6 months ago
- The official repo of Qwen-Audio (通义千问-Audio) chat & pretrained large audio language model proposed by Alibaba Cloud.☆1,750Updated last year
- Codebase for Aria - an Open Multimodal Native MoE☆1,061Updated 6 months ago
- Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding☆626Updated 7 months ago
- Next-Token Prediction is All You Need☆2,173Updated 4 months ago
- ✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models☆639Updated 7 months ago
- Emu Series: Generative Multimodal Models from BAAI☆1,739Updated 10 months ago
- ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM☆333Updated 2 months ago
- 【TMM 2025🔥】 Mixture-of-Experts for Large Vision-Language Models☆2,198Updated 2 weeks ago
- 【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment☆819Updated last year
- VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs☆1,201Updated 6 months ago
- Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration☆1,578Updated 7 months ago
- ☆164Updated 5 months ago
- BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs☆511Updated 2 years ago
- [ACL 2024] Progressive LLaMA with Block Expansion.☆507Updated last year
- ☆619Updated last year
- Inference code for the paper "Spirit-LM Interleaved Spoken and Written Language Model".☆916Updated 9 months ago
- Speech, Language, Audio, Music Processing with Large Language Model☆863Updated last month
- A family of lightweight multimodal models.☆1,023Updated 8 months ago
- [TMLR23] Official implementation of UnIVAL: Unified Model for Image, Video, Audio and Language Tasks.☆228Updated last year
- A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI☆767Updated last year
- [CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding☆637Updated 6 months ago
- [TLLM'23] PandaGPT: One Model To Instruction-Follow Them All☆809Updated 2 years ago