OpenMOSS / AnyGPT
Code for "AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling"
☆780Updated 2 months ago
Related projects ⓘ
Alternatives and complementary repositories for AnyGPT
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆705Updated 9 months ago
- Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation☆675Updated 3 months ago
- ✨✨VITA: Towards Open-Source Interactive Omni Multimodal LLM☆964Updated 3 weeks ago
- The official repo of Qwen-Audio (通义千问-Audio) chat & pretrained large audio language model proposed by Alibaba Cloud.☆1,490Updated 4 months ago
- SpeechGPT Series: Speech Large Language Models☆1,293Updated 3 months ago
- HPT - Open Multimodal LLMs from HyperGAI☆312Updated 5 months ago
- [CVPR 2024] OneLLM: One Framework to Align All Modalities with Language☆590Updated 3 weeks ago
- Janus-Series: Unified Multimodal Understanding and Generation Models☆1,084Updated last week
- [ACL 2024] Progressive LLaMA with Block Expansion.☆478Updated 6 months ago
- ☆573Updated 9 months ago
- Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"☆851Updated 8 months ago
- ☆819Updated last month
- Next-Token Prediction is All You Need☆1,824Updated 3 weeks ago
- VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs☆877Updated last week
- Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊☆234Updated 2 weeks ago
- BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs☆503Updated last year
- Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding☆559Updated last month
- [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition☆594Updated 3 months ago
- A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.☆526Updated 2 weeks ago
- Official implementation of SEED-LLaMA (ICLR 2024).☆579Updated 2 months ago
- A family of lightweight multimodal models.☆933Updated this week
- DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models☆1,008Updated 10 months ago
- SALMONN: Speech Audio Language Music Open Neural Network☆1,057Updated this week
- Official repo for the paper "Scaling Synthetic Data Creation with 1,000,000,000 Personas"☆883Updated last month
- This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for E…☆355Updated last week
- Large Reasoning Models☆580Updated this week
- 【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment☆726Updated 7 months ago
- X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages☆306Updated last year
- Codebase for Merging Language Models (ICML 2024)☆774Updated 6 months ago