Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model
☆3,632May 13, 2025Updated last year
Alternatives and similar repositories for NExT-GPT
Users that are interested in NExT-GPT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.☆24,864Aug 12, 2024Updated last year
- An Open-source Framework for Data-centric, Self-evolving Autonomous Language Agents☆5,933Sep 26, 2024Updated last year
- Latest Advances on Multimodal Large Language Models☆17,868May 1, 2026Updated last month
- a state-of-the-art-level open visual language model | 多模态预训练模型☆6,740May 29, 2024Updated 2 years ago
- [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters☆5,921Mar 14, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"☆865May 8, 2025Updated last year
- Emu Series: Generative Multimodal Models from BAAI☆1,775Jan 12, 2026Updated 5 months ago
- An Open-source Toolkit for LLM Development☆2,805Jan 13, 2025Updated last year
- ImageBind One Embedding Space to Bind Them All☆9,036Nov 21, 2025Updated 6 months ago
- The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.☆6,664Aug 7, 2024Updated last year
- Code for "AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling"☆882Aug 27, 2024Updated last year
- LAVIS - A One-stop Library for Language-Vision Intelligence☆11,236Jun 2, 2026Updated last week
- Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)☆25,681Sep 2, 2024Updated last year
- [SIGGRAPH Asia 2023] Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation☆3,004Mar 9, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ICLR 2024] Efficient Streaming Language Models with Attention Sinks☆7,229Jul 11, 2024Updated last year
- [EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding☆3,143Jun 4, 2024Updated 2 years ago
- 【TMM 2025🔥】 Mixture-of-Experts for Large Vision-Language Models☆2,321Jul 15, 2025Updated 11 months ago
- [COLM 2024] OpenAgents: An Open Platform for Language Agents in the Wild☆4,838Nov 18, 2024Updated last year
- ☆4,687Apr 15, 2026Updated 2 months ago
- VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models☆5,062Jan 9, 2026Updated 5 months ago
- Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)☆2,691Aug 14, 2024Updated last year
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,470May 1, 2026Updated last month
- InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions☆2,925May 26, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Official implementation of SEED-LLaMA (ICLR 2024).☆641Sep 21, 2024Updated last year
- Large World Model -- Modeling Text and Video with Millions Context☆7,417Oct 19, 2024Updated last year
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities☆22,147Jan 23, 2026Updated 4 months ago
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,486Jun 7, 2025Updated last year
- An open-source framework for training large multimodal models.☆4,106Aug 31, 2024Updated last year
- 【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection☆3,491Dec 3, 2024Updated last year
- [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation☆462Dec 2, 2024Updated last year
- NeurIPS 2024 Paper: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editing☆578Oct 20, 2024Updated last year
- The paper list of the 86-page SCIS cover paper "The Rise and Potential of Large Language Model Based Agents: A Survey" by Zhiheng Xi et a…☆8,151Sep 12, 2025Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"☆3,326May 4, 2024Updated 2 years ago
- [CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.☆3,340Jan 18, 2025Updated last year
- Open-Sora: Democratizing Efficient Video Production for All☆29,095Apr 9, 2026Updated 2 months ago
- ☆1,706Sep 27, 2024Updated last year
- [ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.☆5,665May 21, 2025Updated last year
- Meta-Transformer for Unified Multimodal Learning☆1,652Dec 5, 2023Updated 2 years ago
- 🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing imp…☆3,409Mar 5, 2024Updated 2 years ago