Alternatives and similar repositories for Awesome-Multimodal-Chatbot

Users that are interested in Awesome-Multimodal-Chatbot are comparing it to the libraries listed below

• showlab / assistgpt
  ☆66Updated 2 years ago
• cg1177 / VideoLLM
  VideoLLM: Modeling Video Sequence with Large Language Models
  ☆158Updated 2 years ago
• mbzuai-oryx / Video-LLaVA
  PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models
  ☆257Updated last month
• kaleido-lab / dolphin
  General video interaction platform based on LLMs, including Video ChatGPT
  ☆252Updated 2 years ago
• MILVLG / imp
  a family of highly capabale yet efficient large multimodal models
  ☆191Updated last year
• patrick-tssn / Awesome-Colorful-LLM
  Recent advancements propelled by large language models (LLMs), encompassing an array of domains including Vision, Audio, Agent, Robotics,…
  ☆124Updated 3 months ago
• HenryHZY / Awesome-Multimodal-LLM
  Research Trends in LLM-guided Multimodal Learning.
  ☆355Updated last year
• showlab / VideoGUI
  [NeurIPS 2024 D&B] VideoGUI: A Benchmark for GUI Automation from Instructional Videos
  ☆44Updated 3 months ago
• TIGER-AI-Lab / Mantis
  Official code for Paper "Mantis: Multi-Image Instruction Tuning" [TMLR 2024]
  ☆227Updated 5 months ago
• RenShuhuai-Andy / TESTA
  [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
  ☆50Updated last year
• feizc / Visual-LLaMA
  Open LLaMA Eyes to See the World
  ☆174Updated 2 years ago
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆94Updated last year
• OpenGVLab / ControlLLM
  ControlLLM: Augment Language Models with Tools by Searching on Graphs
  ☆193Updated last year
• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆308Updated 8 months ago
• isekai-portal / Link-Context-Learning
  ☆99Updated last year
• dvlab-research / Prompt-Highlighter
  [CVPR 2024] Prompt Highlighter: Interactive Control for Multi-Modal LLMs
  ☆152Updated last year
• RupertLuo / Valley
  The official repository of "Video assistant towards large language model makes everything easy"
  ☆231Updated 8 months ago
• SHI-Labs / VCoder
  [CVPR 2024] VCoder: Versatile Vision Encoders for Multimodal Large Language Models
  ☆278Updated last year
• SHI-Labs / CuMo
  CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts
  ☆153Updated last year
• mbzuai-oryx / VideoGPT-plus
  Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding
  ☆286Updated last month
• SHI-Labs / OLA-VLM
  OLA-VLM: Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024
  ☆61Updated 6 months ago
• imagegridworth / IG-VLM
  ☆138Updated 11 months ago
• Ahnsun / merlin
  [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds
  ☆94Updated last year
• kyegomez / PALI
  Democratization of "PaLI: A Jointly-Scaled Multilingual Language-Image Model"
  ☆92Updated last year
• MBZUAI-LLM / web2code
  Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs
  ☆90Updated 10 months ago
• zzxslp / SoM-LLaVA
  [COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs
  ☆144Updated last year
• FudanNLPLAB / MouSi
  ☆74Updated last year
• sanjayss34 / codevqa
  ☆84Updated 2 years ago
• mshukor / UnIVAL
  [TMLR23] Official implementation of UnIVAL: Unified Model for Image, Video, Audio and Language Tasks.
  ☆229Updated last year
• AILab-CVC / SEED-Bench
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
  ☆348Updated 8 months ago