Alternatives and similar repositories for qformer

Users that are interested in qformer are comparing it to the libraries listed below

• bojone / FSQ
  Keras implement of Finite Scalar Quantization
  ☆83Updated last year
• amazon-science / masked-diffusion-lm
  Official implementation for the paper "A Cheaper and Better Diffusion Language Model with Soft-Masked Noise"
  ☆59Updated 2 years ago
• TsinghuaC3I / Fourier-Position-Embedding
  [ICML 2025] Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalization
  ☆99Updated 4 months ago
• lucidrains / multimodal-dit-pytorch
  Implementation of a multimodal diffusion transformer in Pytorch
  ☆105Updated last year
• lucidrains / maskbit-pytorch
  Implementation of the proposed MaskBit from Bytedance AI
  ☆82Updated 10 months ago
• zh460045050 / VQGAN-LC
  ☆137Updated last year
• lzw-lzw / UnifiedMLLM
  UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model
  ☆22Updated last year
• lucidrains / agent-attention-pytorch
  Implementation of Agent Attention in Pytorch
  ☆92Updated last year
• Neur-IO / ReVQ
  Explore how to get a VQ-VAE models efficiently!
  ☆56Updated 2 months ago
• OpenNLPLab / Tnn
  [ICLR 2023] Official implementation of Transnormer in our ICLR 2023 paper - Toeplitz Neural Network for Sequence Modeling
  ☆80Updated last year
• transformer-vq / transformer_vq
  ☆197Updated last year
• fla-org / flash-bidirectional-linear-attention
  Triton implement of bi-directional (non-causal) linear attention
  ☆56Updated 8 months ago
• 360CVGroup / Inner-Adaptor-Architecture
  LMM solved catastrophic forgetting, AAAI2025
  ☆44Updated 5 months ago
• WailordHe / DenseSSM
  A repository for DenseSSMs
  ☆88Updated last year
• cfifty / rotation_trick
  ☆151Updated 6 months ago
• kyegomez / MAGVIT2
  Open source community's implementation of the model from "LANGUAGE MODEL BEATS DIFFUSION — TOKENIZER IS KEY TO VISUAL GENERATION"
  ☆13Updated 10 months ago
• kyegomez / Mirasol
  Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"
  ☆25Updated 8 months ago
• Optimization-AI / FastCLIP
  Distributed Optimization Infra for learning CLIP models
  ☆27Updated last year
• zehanwang01 / OmniBind
  ☆33Updated 5 months ago
• jindongli-Ai / LLM-Discrete-Tokenization-Survey
  The official GitHub page for the survey paper "Discrete Tokenization for Multimodal LLMs: A Comprehensive Survey". And this paper is unde…
  ☆64Updated last month
• lucasjinreal / LLaVA-Magvit2
  LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.
  ☆37Updated last year
• AILab-CVC / M2PT
  [CVPR 2024] Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities
  ☆99Updated last year
• jacklishufan / OmniFlows
  The official implementation of OmniFlow: Any-to-Any Generation with Multi-Modal Rectified Flows
  ☆113Updated last month
• jadehaus / preference-flow-matching
  Official code implementation for the work Preference Alignment with Flow Matching (NeurIPS 2024)
  ☆58Updated 10 months ago
• MCR-PEFT / Ex-MCR
  ☆44Updated 4 months ago
• TIGER-AI-Lab / Vamba
  Code for the paper "Vamba: Understanding Hour-Long Videos with Hybrid Mamba-Transformers" [ICCV 2025]
  ☆86Updated 2 months ago
• shaochenze / PatchTrain
  Code for paper "Patch-Level Training for Large Language Models"
  ☆88Updated 10 months ago
• layer6ai-labs / fusemix
  Data-Efficient Multimodal Fusion on a Single GPU
  ☆68Updated last year
• haoliuhl / language-quantized-autoencoders
  Language Quantized AutoEncoders
  ☆109Updated 2 years ago
• MIO-Team / MIO
  MIO: A Foundation Model on Multimodal Tokens
  ☆30Updated 9 months ago