EvolvingLMMs-Lab / Otter
🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
☆3,251Updated last year
Alternatives and similar repositories for Otter:
Users that are interested in Otter are comparing it to the libraries listed below
- Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration☆1,563Updated 4 months ago
- An Open-source Toolkit for LLM Development☆2,776Updated 3 months ago
- [ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.☆5,016Updated 5 months ago
- Tool Learning for Big Models, Open-Source Solutions of ChatGPT-Plugins☆2,786Updated last year
- Multimodal-GPT☆1,498Updated last year
- [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters☆5,868Updated last year
- Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model☆3,492Updated 6 months ago
- [CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.☆3,225Updated 3 months ago
- Emu Series: Generative Multimodal Models from BAAI☆1,716Updated 7 months ago
- Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.☆2,416Updated this week
- ☆773Updated 8 months ago
- An open-source framework for training large multimodal models.☆3,906Updated 8 months ago
- [EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding☆2,998Updated 11 months ago
- mPLUG-Owl: The Powerful Multi-modal Large Language Model Family☆2,468Updated last month
- Large-scale, Informative, and Diverse Multi-round Chat Data (and Models)☆2,561Updated last year
- [TLLM'23] PandaGPT: One Model To Instruction-Follow Them All☆784Updated last year
- Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)☆2,654Updated 8 months ago
- [CVPR'23] Universal Instance Perception as Object Discovery and Retrieval☆1,270Updated last year
- 【CVPR 2024 Highlight】Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models☆1,752Updated 2 weeks ago
- The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"☆718Updated 3 weeks ago
- [ICLR'24 spotlight] Chinese and English Multimodal Large Model Series (Chat and Paint) | 基于CPM基础模型的中英双语多模态大模型系列☆1,056Updated 10 months ago
- A family of lightweight multimodal models.☆1,015Updated 5 months ago
- Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"☆863Updated 4 months ago
- Mixture-of-Experts for Large Vision-Language Models☆2,153Updated 5 months ago
- Open-source and strong foundation image recognition models.☆3,216Updated 2 months ago
- Project Page for "LISA: Reasoning Segmentation via Large Language Model"☆2,185Updated 2 months ago
- InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBin…☆3,215Updated 8 months ago
- ☆1,698Updated 7 months ago
- 🤖 AgentVerse 🪐 is designed to facilitate the deployment of multiple LLM-based agents in various applications, which primarily provides …☆4,514Updated 7 months ago
- Instruction Tuning with GPT-4☆4,301Updated last year