Alternatives and similar repositories for qformer:

Users that are interested in qformer are comparing it to the libraries listed below

• 360CVGroup / Inner-Adaptor-Architecture
  LMM solved catastrophic forgetting, AAAI2025
  ☆40Updated 4 months ago
• kyegomez / Mirasol
  Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"
  ☆26Updated 2 months ago
• bojone / FSQ
  Keras implement of Finite Scalar Quantization
  ☆71Updated last year
• lucasjinreal / LLaVA-Magvit2
  LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.
  ☆35Updated 9 months ago
• RainBowLuoCS / OpenOmni
  OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Rea…
  ☆40Updated 2 weeks ago
• lzw-lzw / UnifiedMLLM
  UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model
  ☆21Updated 7 months ago
• fla-org / flash-bidirectional-linear-attention
  Triton implement of bi-directional (non-causal) linear attention
  ☆44Updated last month
• MIO-Team / MIO
  MIO: A Foundation Model on Multimodal Tokens
  ☆22Updated 3 months ago
• OpenSparseLLMs / Open-Pandora
  Open-Pandora: On-the-fly Control Video Generation
  ☆32Updated 4 months ago
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆37Updated 5 months ago
• xiangyu-mm / EasyGen
  The official code for paper "EasyGen: Easing Multimodal Generation with a Bidirectional Conditional Diffusion Model and LLMs"
  ☆73Updated 4 months ago
• OpenNLPLab / Tnn
  [ICLR 2023] Official implementation of Transnormer in our ICLR 2023 paper - Toeplitz Neural Network for Sequence Modeling
  ☆79Updated 11 months ago
• emova-ollm / EMOVA
  Official PyTorch implementation of EMOVA in CVPR 2025 (https://arxiv.org/abs/2409.18042)
  ☆23Updated 2 weeks ago
• jadehaus / preference-flow-matching
  Official code implementation for the work Preference Alignment with Flow Matching (NeurIPS 2024)
  ☆45Updated 4 months ago
• HelmholtzAI-FZJ / flex_gen
  ☆17Updated 2 months ago
• OpenNLPLab / Transnormer
  [EMNLP 2022] Official implementation of Transnormer in our EMNLP 2022 paper - The Devil in Linear Transformer
  ☆60Updated last year
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆12Updated 9 months ago
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆44Updated 3 months ago
• Optimization-AI / fast_clip
  ☆23Updated 5 months ago
• Kevinz-code / SeVa
  [MM2024, oral] "Self-Supervised Visual Preference Alignment" https://arxiv.org/abs/2404.10501
  ☆55Updated 8 months ago
• BBuf / flash-rwkv
  ☆30Updated 10 months ago
• OpenSparseLLMs / Linearization
  ☆37Updated last week
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆131Updated 4 months ago
• kakaobrain / magvlt
  The official implementation of MAGVLT: Masked Generative Vision-and-Language Transformer (CVPR'23)
  ☆26Updated last year
• mlfoundations / VisIT-Bench
  ☆49Updated last year
• NJUNLP / MoE-LPR
  ☆11Updated 3 months ago
• beichenzbc / BoostStep
  official code for "BoostStep: Boosting mathematical capability of Large Language Models via improved single-step reasoning"
  ☆33Updated 2 months ago
• FudanNLPLAB / MouSi
  ☆73Updated last year
• BestAnHongjun / SentenceVAE
  Enable Next-sentence Prediction for Large Language Models with Faster Speed, Higher Accuracy and Longer Context
  ☆28Updated 7 months ago
• kyegomez / TTL
  Pytorch Implementation of the paper: "Learning to (Learn at Test Time): RNNs with Expressive Hidden States"
  ☆24Updated last week