mshukor / UnIVAL

Related projects ⓘ

Alternatives and complementary repositories for UnIVAL

• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆142Updated last week
• SALT-NLP / LLaVAR
  Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"
  ☆258Updated 5 months ago
• SHI-Labs / VCoder
  VCoder: Versatile Vision Encoders for Multimodal Large Language Models, arXiv 2023 / CVPR 2024
  ☆261Updated 7 months ago
• OpenGVLab / ControlLLM
  ControlLLM: Augment Language Models with Tools by Searching on Graphs
  ☆186Updated 4 months ago
• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆267Updated 2 weeks ago
• kohjingyu / gill
  🐟 Code and models for the NeurIPS 2023 paper "Generating Images with Multimodal Language Models".
  ☆433Updated 10 months ago
• MILVLG / imp
  a family of highly capabale yet efficient large multimodal models
  ☆166Updated 2 months ago
• mbzuai-oryx / Video-LLaVA
  PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models
  ☆245Updated 10 months ago
• AILab-CVC / SEED-Bench
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
  ☆315Updated 4 months ago
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆334Updated 3 weeks ago
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆91Updated 10 months ago
• fabawi / ImageBind-LoRA
  Fine-tuning "ImageBind One Embedding Space to Bind Them All" with LoRA
  ☆176Updated 11 months ago
• VPGTrans / VPGTrans
  Codes for VPGTrans: Transfer Visual Prompt Generator across LLMs. VL-LLaMA, VL-Vicuna.
  ☆269Updated last year
• md-mohaiminul / VideoRecap
  ☆165Updated 4 months ago
• THUDM / CogCoM
  ☆152Updated 4 months ago
• HyperGAI / HPT
  HPT - Open Multimodal LLMs from HyperGAI
  ☆312Updated 5 months ago
• boheumd / MA-LMM
  (2024CVPR) MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding
  ☆244Updated 4 months ago
• MBZUAI-LLM / web2code
  Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs
  ☆62Updated 3 weeks ago
• kyegomez / PALI
  Democratization of "PaLI: A Jointly-Scaled Multilingual Language-Image Model"
  ☆86Updated 8 months ago
• OpenGVLab / MM-Interleaved
  MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer
  ☆197Updated 7 months ago
• kongds / E5-V
  E5-V: Universal Embeddings with Multimodal Large Language Models
  ☆173Updated 4 months ago
• FreedomIntelligence / ALLaVA
  Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model
  ☆246Updated 4 months ago
• TIGER-AI-Lab / Mantis
  Official code for Paper "Mantis: Multi-Image Instruction Tuning" (TMLR2024)
  ☆184Updated this week
• IVGSZ / Flash-VStream
  This is the official implementation of "Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams"
  ☆130Updated 3 months ago
• yfzhang114 / SliME
  ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models
  ☆137Updated last week
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆179Updated last month
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆115Updated last week
• X2FD / LVIS-INSTRUCT4V
  ☆131Updated 10 months ago
• bytedance / Shot2Story
  A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.
  ☆99Updated last month
• RunpeiDong / DreamLLM
  [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation
  ☆395Updated 7 months ago