Alternatives and similar repositories for DnD-Transformer:

Users that are interested in DnD-Transformer are comparing it to the libraries listed below

• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆97Updated 3 weeks ago
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆44Updated last month
• DAMO-NLP-SG / DiGIT
  [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective
  ☆59Updated 3 months ago
• UCSC-VLAA / Recap-DataComp-1B
  This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"
  ☆128Updated 8 months ago
• zeyofu / BLINK_Benchmark
  This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…
  ☆116Updated 7 months ago
• rese1f / aurora
  [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark
  ☆75Updated 3 weeks ago
• Beckschen / LLaVolta
  [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression
  ☆51Updated this week
• allenai / unified-io-2.pytorch
  ☆68Updated 7 months ago
• j-min / VPGen
  Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆54Updated last year
• Epiphqny / PAR
  The official implementation of PAR: Parallelized Autoregressive Visual Generation. https://epiphqny.github.io/PAR-project/
  ☆110Updated last month
• OpenGVLab / TPO
  Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment
  ☆41Updated last month
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆94Updated last year
• xichenpan / Kosmos-G
  Official Implementation of ICLR'24: Kosmos-G: Generating Images in Context with Multimodal Large Language Models
  ☆62Updated 8 months ago
• Yxxxb / VoCo-LLaMA
  VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".
  ☆95Updated 7 months ago
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆101Updated 2 weeks ago
• SilentView / LVD-2M
  [NeurIPS 2024 D&B Track] Official Repo for "LVD-2M: A Long-take Video Dataset with Temporally Dense Captions"
  ☆45Updated 4 months ago
• facebookresearch / EvalGIM
  🦾 EvalGIM (pronounced as "EvalGym") is an evaluation library for generative image models. It enables easy-to-use, reproducible automatic…
  ☆66Updated 2 months ago
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆127Updated 3 months ago
• snap-research / MyVLM
  Official Implementation for "MyVLM: Personalizing VLMs for User-Specific Queries" (ECCV 2024)
  ☆162Updated 7 months ago
• eclipse-t2i / eclipse-inference
  [CVPR 2024] Official PyTorch implementation of "ECLIPSE: Revisiting the Text-to-Image Prior for Efficient Image Generation"
  ☆62Updated 9 months ago
• j-min / DSG
  Davidsonian Scene Graph (DSG) for Text-to-Image Evaluation (ICLR 2024)
  ☆84Updated 2 months ago
• ThisisBillhe / ZipAR
  This is the official PyTorch implementation of "ZipAR: Accelerating Auto-regressive Image Generation through Spatial Locality"
  ☆45Updated last month
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆59Updated 7 months ago
• MonoFormer / MonoFormer
  The official implementation for "MonoFormer: One Transformer for Both Diffusion and Autoregression"
  ☆84Updated 4 months ago
• OpenGVLab / MMIU
  [ICLR2025] MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models
  ☆61Updated 5 months ago
• causalfusion / causalfusion
  ☆138Updated 2 months ago
• UX-Decoder / FIND
  [NeurIPS 2024] Official implementation of the paper "Interfacing Foundation Models' Embeddings"
  ☆120Updated 6 months ago
• AILab-CVC / VL-GPT
  VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation
  ☆85Updated 5 months ago