EvolvingLMMs-Lab / OtterLinks
𦦠Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
β3,283Updated last year
Alternatives and similar repositories for Otter
Users that are interested in Otter are comparing it to the libraries listed below
Sorting:
- Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integrationβ1,596Updated last year
- An Open-source Toolkit for LLM Developmentβ2,797Updated 11 months ago
- [ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.β5,459Updated 7 months ago
- mPLUG-Owl: The Powerful Multi-modal Large Language Model Familyβ2,540Updated 9 months ago
- One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasksβ3,531Updated last week
- Tool Learning for Big Models, Open-Source Solutions of ChatGPT-Pluginsβ2,787Updated 2 years ago
- Large-scale, Informative, and Diverse Multi-round Chat Data (and Models)β2,759Updated last year
- Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models (CVPR 2024 Highlight)β1,942Updated 2 months ago
- Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)β2,696Updated last year
- Uni-MoE: Lychee's Large Multimodal Model Family.β1,066Updated 3 weeks ago
- An open-source framework for training large multimodal models.β4,056Updated last year
- [CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.β3,330Updated 11 months ago
- [CVPR'23] Universal Instance Perception as Object Discovery and Retrievalβ1,280Updated 2 years ago
- Multimodal-GPTβ1,516Updated 2 years ago
- Emu Series: Generative Multimodal Models from BAAIβ1,762Updated last year
- Project Page for "LISA: Reasoning Segmentation via Large Language Model"β2,549Updated 10 months ago
- [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parametersβ5,934Updated last year
- [EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingβ3,110Updated last year
- Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Modelβ3,605Updated 7 months ago
- β791Updated last year
- [IJCV] Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationβ1,133Updated 3 months ago
- β1,708Updated last year
- [ICLR'24 spotlight] Chinese and English Multimodal Large Model Series (Chat and Paint) | εΊδΊCPMεΊη‘樑εηδΈθ±εθ―ε€ζ¨‘ζ倧樑εη³»εβ1,072Updated last year
- Collection of AWESOME vision-language models for vision tasksβ3,051Updated 2 months ago
- Official Repo For OMG-LLaVA and OMG-Seg codebase [CVPR-24 and NeurIPS-24]β1,338Updated 2 months ago
- [CVPR2024 Highlight]GLEE: General Object Foundation Model for Images and Videos at Scaleβ1,168Updated last year
- [TLLM'23] PandaGPT: One Model To Instruction-Follow Them Allβ841Updated 2 years ago
- A family of lightweight multimodal models.β1,049Updated last year
- Caption-Anything is a versatile tool combining image segmentation, visual captioning, and ChatGPT, generating tailored captions with diveβ¦β1,774Updated 2 years ago
- Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"β863Updated 8 months ago