Alternatives and similar repositories for qformer

Users that are interested in qformer are comparing it to the libraries listed below

• bojone / FSQ
  Keras implement of Finite Scalar Quantization
  ☆83Updated 2 years ago
• lzw-lzw / UnifiedMLLM
  UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model
  ☆22Updated last year
• lucidrains / multimodal-dit-pytorch
  Implementation of a multimodal diffusion transformer in Pytorch
  ☆107Updated last year
• TsinghuaC3I / Fourier-Position-Embedding
  [ICML 2025] Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalization
  ☆104Updated 6 months ago
• zh460045050 / VQGAN-LC
  ☆140Updated last year
• kyegomez / Mirasol
  Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"
  ☆26Updated 10 months ago
• amazon-science / masked-diffusion-lm
  Official implementation for the paper "A Cheaper and Better Diffusion Language Model with Soft-Masked Noise"
  ☆59Updated 2 years ago
• multimodal-art-projection / OmniBench
  A project for tri-modal LLM benchmarking and instruction tuning.
  ☆52Updated 8 months ago
• lucidrains / maskbit-pytorch
  Implementation of the proposed MaskBit from Bytedance AI
  ☆83Updated last year
• cfifty / rotation_trick
  ☆156Updated 8 months ago
• kyegomez / TTL
  Pytorch Implementation of the paper: "Learning to (Learn at Test Time): RNNs with Expressive Hidden States"
  ☆25Updated 2 weeks ago
• lucasjinreal / LLaVA-Magvit2
  LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.
  ☆39Updated last year
• zhixuan-lin / forgetting-transformer
  [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning
  ☆134Updated last month
• MIO-Team / MIO
  MIO: A Foundation Model on Multimodal Tokens
  ☆32Updated last year
• jadehaus / preference-flow-matching
  Official code implementation for the work Preference Alignment with Flow Matching (NeurIPS 2024)
  ☆62Updated last year
• BriansIDP / video-SALMONN-o1
  ☆37Updated 3 months ago
• transformer-vq / transformer_vq
  ☆200Updated 2 years ago
• invictus717 / MiCo
  [ICCV 2025] Explore the Limits of Omni-modal Pretraining at Scale
  ☆121Updated last year
• kakaobrain / magvlt
  The official implementation of MAGVLT: Masked Generative Vision-and-Language Transformer (CVPR'23)
  ☆28Updated last year
• OpenNLPLab / Tnn
  [ICLR 2023] Official implementation of Transnormer in our ICLR 2023 paper - Toeplitz Neural Network for Sequence Modeling
  ☆81Updated last year
• WailordHe / DenseSSM
  A repository for DenseSSMs
  ☆89Updated last year
• jacklishufan / OmniFlows
  The official implementation of OmniFlow: Any-to-Any Generation with Multi-Modal Rectified Flows
  ☆121Updated 3 months ago
• huggingface / fineVideo
  ☆94Updated last year
• Optimization-AI / FastCLIP
  Distributed Optimization Infra for learning CLIP models
  ☆27Updated last year
• hamishivi / tess-2
  Repository for "TESS-2: A Large-Scale, Generalist Diffusion Language Model"
  ☆53Updated 9 months ago
• emova-ollm / EMOVA
  Official PyTorch implementation of EMOVA in CVPR 2025 (https://arxiv.org/abs/2409.18042)
  ☆74Updated 8 months ago
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆54Updated 5 months ago
• Neur-IO / ReVQ
  Explore how to get a VQ-VAE models efficiently!
  ☆64Updated 4 months ago
• kyegomez / MultiModalCrossAttn
  The open source implementation of the cross attention mechanism from the paper: "JOINTLY TRAINING LARGE AUTOREGRESSIVE MULTIMODAL MODELS"
  ☆36Updated last year
• layer6ai-labs / fusemix
  Data-Efficient Multimodal Fusion on a Single GPU
  ☆68Updated last year