Alternatives and similar repositories for DnD-Transformer

Users that are interested in DnD-Transformer are comparing it to the libraries listed below

• zeyofu / BLINK_Benchmark
  This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…
  ☆127Updated 11 months ago
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆110Updated 5 months ago
• facebookresearch / metamorph
  Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning
  ☆191Updated 2 months ago
• DAMO-NLP-SG / DiGIT
  [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective
  ☆69Updated 7 months ago
• visual-gen / semanticist
  Code for paper "Principal Components" Enable A New Language of Images
  ☆44Updated 2 weeks ago
• TIGER-AI-Lab / VL-Rethinker
  The official code of "VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning"
  ☆118Updated 2 weeks ago
• M-E-AGI-Lab / Muddit
  Official Implementation of Muddit [Meissonic II]: Liberating Generation Beyond Text-to-Image with a Unified Discrete Diffusion Model.
  ☆59Updated 3 weeks ago
• UCSC-VLAA / Recap-DataComp-1B
  [ICML 2025] This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"
  ☆134Updated last year
• NVlabs / QLIP
  [arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation
  ☆75Updated 3 months ago
• ML-GSAI / LLaDA-V
  ☆152Updated last week
• hp-l33 / ARPG
  Autoregressive Image Generation with Randomized Parallel Decoding
  ☆67Updated 2 months ago
• jacklishufan / LaViDa
  Official Implementation of LaViDa: :A Large Diffusion Language Model for Multimodal Understanding
  ☆96Updated this week
• TIGER-AI-Lab / MEGA-Bench
  This repo contains the code for "MEGA-Bench Scaling Multimodal Evaluation to over 500 Real-World Tasks" [ICLR2025]
  ☆68Updated 2 months ago
• aszala / VPEval
  VPEval Codebase from Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆45Updated last year
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆64Updated 11 months ago
• tang-bd / fuse-dit
  [CVPR 2025] Exploring the Deep Fusion of Large Language Models and Diffusion Transformers for Text-to-Image Synthesis
  ☆109Updated last month
• j-min / VPGen
  Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆56Updated last year
• TIGER-AI-Lab / Vamba
  Code for the paper "Vamba: Understanding Hour-Long Videos with Hybrid Mamba-Transformers"
  ☆71Updated 3 months ago
• Beckschen / LLaVolta
  [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression
  ☆60Updated 4 months ago
• SilentView / LVD-2M
  [NeurIPS 2024 D&B Track] Official Repo for "LVD-2M: A Long-take Video Dataset with Temporally Dense Captions"
  ☆62Updated 8 months ago
• MonoFormer / MonoFormer
  The official implementation for "MonoFormer: One Transformer for Both Diffusion and Autoregression"
  ☆87Updated 8 months ago
• EvolvingLMMs-Lab / VideoMMMU
  ☆49Updated 2 months ago
• egolife-ai / Ego-R1
  Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoning
  ☆70Updated this week
• TencentARC / MindOmni
  ☆66Updated this week
• si0wang / VisVM
  ☆44Updated 5 months ago
• TIGER-AI-Lab / QuickVideo
  Quick Long Video Understanding
  ☆55Updated last week
• Gen-Verse / HermesFlow
  HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation
  ☆63Updated 4 months ago
• bronyayang / Law_of_Vision_Representation_in_MLLMs
  Official implementation of the Law of Vision Representation in MLLMs
  ☆156Updated 7 months ago
• XMUDeepLIT / AVG-LLaVA
  Code for "AVG-LLaVA: A Multimodal Large Model with Adaptive Visual Granularity"
  ☆28Updated 8 months ago
• zhijie-group / Orthus
  ☆37Updated last month