EvolvingLMMs-Lab / Otter
🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
☆3,241Updated last year
Alternatives and similar repositories for Otter:
Users that are interested in Otter are comparing it to the libraries listed below
- Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration☆1,560Updated 2 months ago
- An Open-source Toolkit for LLM Development☆2,763Updated 2 months ago
- Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.☆2,228Updated this week
- An open-source framework for training large multimodal models.☆3,857Updated 6 months ago
- [ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.☆4,933Updated 4 months ago
- Project Page for "LISA: Reasoning Segmentation via Large Language Model"☆2,085Updated last month
- Multimodal-GPT☆1,495Updated last year
- 【CVPR 2024 Highlight】Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models☆1,730Updated this week
- Large-scale, Informative, and Diverse Multi-round Chat Data (and Models)☆2,508Updated last year
- [CVPR'23] Universal Instance Perception as Object Discovery and Retrieval☆1,266Updated last year
- Tool Learning for Big Models, Open-Source Solutions of ChatGPT-Plugins☆2,774Updated last year
- [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters☆5,838Updated last year
- [IJCV] Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation☆1,053Updated 4 months ago
- Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)☆2,652Updated 7 months ago
- Emu Series: Generative Multimodal Models from BAAI☆1,695Updated 5 months ago
- The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"☆703Updated last month
- ☆772Updated 8 months ago
- OMG-LLaVA and OMG-Seg codebase [CVPR-24 and NeurIPS-24]☆1,259Updated 3 months ago
- ☆770Updated 7 months ago
- Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"☆864Updated 3 months ago
- ⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡☆2,937Updated last year
- [ ICLR 2024 ] Official Codebase for "InstructCV: Instruction-Tuned Text-to-Image Diffusion Models as Vision Generalists"☆460Updated 10 months ago
- 【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection☆3,196Updated 3 months ago
- mPLUG-Owl: The Powerful Multi-modal Large Language Model Family☆2,438Updated 2 months ago
- ☆1,692Updated 5 months ago
- LOMO: LOw-Memory Optimization☆979Updated 8 months ago
- [CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.☆3,194Updated 2 months ago
- [TLLM'23] PandaGPT: One Model To Instruction-Follow Them All☆782Updated last year
- [NeurIPS 2023] Official implementation of the paper "Segment Everything Everywhere All at Once"☆4,533Updated 7 months ago
- [CVPR 2023] Official Implementation of X-Decoder for generalized decoding for pixel, image and language☆1,309Updated last year