Alternatives and similar repositories for DnD-Transformer:

Users that are interested in DnD-Transformer are comparing it to the libraries listed below

• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆98Updated 2 months ago
• UCSC-VLAA / Recap-DataComp-1B
  This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"
  ☆128Updated 9 months ago
• zeyofu / BLINK_Benchmark
  This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…
  ☆115Updated 8 months ago
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆44Updated 2 months ago
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆130Updated 4 months ago
• j-min / VPGen
  Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆56Updated last year
• para-lost / AutoPresent
  Code for the paper "AutoPresent: Designing Structured Visuals From Scratch" (CVPR 2025)
  ☆60Updated 3 weeks ago
• TIGER-AI-Lab / MEGA-Bench
  This repo contains the code for "MEGA-Bench Scaling Multimodal Evaluation to over 500 Real-World Tasks" [ICLR2025]
  ☆60Updated last week
• Beckschen / LLaVolta
  [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression
  ☆52Updated last month
• DAMO-NLP-SG / DiGIT
  [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective
  ☆64Updated 4 months ago
• j-min / DSG
  Davidsonian Scene Graph (DSG) for Text-to-Image Evaluation (ICLR 2024)
  ☆86Updated 3 months ago
• YuqingWang1029 / PAR
  [CVPR2025] PAR: Parallelized Autoregressive Visual Generation. https://epiphqny.github.io/PAR-project/
  ☆126Updated 2 months ago
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆94Updated last year
• facebookresearch / EvalGIM
  🦾 EvalGIM (pronounced as "EvalGym") is an evaluation library for generative image models. It enables easy-to-use, reproducible automatic…
  ☆68Updated 3 months ago
• aszala / VPEval
  VPEval Codebase from Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆44Updated last year
• shulin16 / MMInA
  Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"
  ☆41Updated 3 weeks ago
• OpenGVLab / TPO
  Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment
  ☆44Updated 2 months ago
• xichenpan / Kosmos-G
  Official Implementation of ICLR'24: Kosmos-G: Generating Images in Context with Multimodal Large Language Models
  ☆68Updated 9 months ago
• rese1f / aurora
  [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark
  ☆84Updated 2 months ago
• SHI-Labs / OLA-VLM
  OLA-VLM: Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024
  ☆57Updated 3 weeks ago
• eclipse-t2i / eclipse-inference
  [CVPR 2024] Official PyTorch implementation of "ECLIPSE: Revisiting the Text-to-Image Prior for Efficient Image Generation"
  ☆62Updated 10 months ago
• EvolvingLMMs-Lab / multimodal-sae
  Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆120Updated last month
• allenai / unified-io-2.pytorch
  ☆71Updated 8 months ago
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆40Updated 4 months ago
• showlab / EvolveDirector
  [NeurIPS 2024] EvolveDirector: Approaching Advanced Text-to-Image Generation with Large Vision-Language Models.
  ☆47Updated 5 months ago
• wangyuchi369 / LaDiC
  [NAACL 2024] LaDiC: Are Diffusion Models Really Inferior to Autoregressive Counterparts for Image-to-text Generation?
  ☆36Updated 9 months ago