allenai / unified-io-2

Related projects: ⓘ

• AILab-CVC / SEED
  Official implementation of SEED-LLaMA (ICLR 2024).
  ☆557Updated 5 months ago
• jy0205 / LaVIT
  LaVIT: Empower the Large Language Model to Understand and Generate Visual Content
  ☆496Updated 2 months ago
• LLaVA-VL / LLaVA-Plus-Codebase
  LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
  ☆692Updated 7 months ago
• kohjingyu / gill
  🐟 Code and models for the NeurIPS 2023 paper "Generating Images with Multimodal Language Models".
  ☆415Updated 8 months ago
• RunpeiDong / DreamLLM
  [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation
  ☆378Updated 5 months ago
• OpenGVLab / all-seeing
  [ICLR 2024 & ECCV 2024] The All-Seeing Projects: Towards Panoptic Visual Recognition&Understanding and General Relation Comprehension of …
  ☆444Updated last month
• bfshi / scaling_on_scales
  When do we not need larger vision models?
  ☆314Updated last month
• thunlp / LLaVA-UHD
  LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Images
  ☆298Updated last month
• AILab-CVC / SEED-Bench
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
  ☆303Updated 2 months ago
• penghao-wu / vstar
  PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"
  ☆502Updated 8 months ago
• csuhan / OneLLM
  [CVPR 2024] OneLLM: One Framework to Align All Modalities with Language
  ☆553Updated this week
• TencentARC / Open-MAGVIT2
  Open-MAGVIT2: Democratizing Autoregressive Visual Generation
  ☆579Updated last week
• magic-research / PLLaVA
  Official repository for the paper PLLaVA
  ☆551Updated last month
• showlab / Show-o
  Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.
  ☆797Updated this week
• BAAI-DCAI / Bunny
  A family of lightweight multimodal models.
  ☆877Updated 2 weeks ago
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆293Updated 3 weeks ago
• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆252Updated 3 weeks ago
• LLaVA-VL / LLaVA-Interactive-Demo
  LLaVA-Interactive-Demo
  ☆344Updated last month
• llava-rlhf / LLaVA-RLHF
  Aligning LMMs with Factually Augmented RLHF
  ☆302Updated 10 months ago
• tsb0601 / MMVP
  ☆277Updated 7 months ago
• GAIR-NLP / anole
  Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation
  ☆644Updated last month
• OpenGVLab / Multi-Modality-Arena
  Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing imag…
  ☆441Updated 4 months ago
• TinyLLaVA / TinyLLaVA_Factory
  A Framework of Small-scale Large Multimodal Models
  ☆568Updated last week
• Meituan-AutoML / VisionLLaMA
  VisionLLaMA: A Unified LLaMA Backbone for Vision Tasks
  ☆354Updated 2 months ago
• TRI-ML / prismatic-vlms
  A flexible and efficient codebase for training visually-conditioned language models (VLMs)
  ☆414Updated 2 months ago
• FoundationVision / LlamaGen
  Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation
  ☆1,197Updated last month
• MMMU-Benchmark / MMMU
  This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for E…
  ☆323Updated last week
• h-zhao1997 / cobra
  Cobra: Extending Mamba to Multi-modal Large Language Model for Efficient Inference
  ☆240Updated last month
• NVlabs / VILA-archive
  ☆246Updated this week
• mlfoundations / datacomp
  DataComp: In search of the next generation of multimodal datasets
  ☆636Updated 8 months ago