Alternatives and similar repositories for qformer

Users that are interested in qformer are comparing it to the libraries listed below

• bojone / FSQ
  Keras implement of Finite Scalar Quantization
  ☆79Updated last year
• kyegomez / Mirasol
  Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"
  ☆26Updated 6 months ago
• lzw-lzw / UnifiedMLLM
  UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model
  ☆22Updated last year
• 360CVGroup / Inner-Adaptor-Architecture
  LMM solved catastrophic forgetting, AAAI2025
  ☆44Updated 3 months ago
• SparksJoe / Prism
  A Framework for Decoupling and Assessing the Capabilities of VLMs
  ☆44Updated last year
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆13Updated last year
• WailordHe / DenseSSM
  A repository for DenseSSMs
  ☆88Updated last year
• amazon-science / masked-diffusion-lm
  Official implementation for the paper "A Cheaper and Better Diffusion Language Model with Soft-Masked Noise"
  ☆58Updated last year
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆39Updated 10 months ago
• multimodal-art-projection / OmniBench
  A project for tri-modal LLM benchmarking and instruction tuning.
  ☆42Updated 4 months ago
• fla-org / flash-bidirectional-linear-attention
  Triton implement of bi-directional (non-causal) linear attention
  ☆51Updated 6 months ago
• mlfoundations / VisIT-Bench
  ☆50Updated last year
• kyegomez / TTL
  Pytorch Implementation of the paper: "Learning to (Learn at Test Time): RNNs with Expressive Hidden States"
  ☆25Updated 3 weeks ago
• OpenNLPLab / Tnn
  [ICLR 2023] Official implementation of Transnormer in our ICLR 2023 paper - Toeplitz Neural Network for Sequence Modeling
  ☆79Updated last year
• lucasjinreal / LLaVA-Magvit2
  LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.
  ☆37Updated last year
• nbasyl / DoRA
  Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"
  ☆124Updated last year
• MCR-PEFT / Ex-MCR
  ☆44Updated 2 months ago
• xiangyu-mm / EasyGen
  The official code for paper "EasyGen: Easing Multimodal Generation with a Bidirectional Conditional Diffusion Model and LLMs"
  ☆74Updated 8 months ago
• shaochenze / PatchTrain
  Code for paper "Patch-Level Training for Large Language Models"
  ☆86Updated 8 months ago
• lucidrains / multimodal-dit-pytorch
  Implementation of a multimodal diffusion transformer in Pytorch
  ☆102Updated last year
• FreedomIntelligence / MLLM-Bench
  MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria
  ☆70Updated 9 months ago
• zh460045050 / VQGAN-LC
  ☆132Updated last year
• OpenNLPLab / Transnormer
  [EMNLP 2022] Official implementation of Transnormer in our EMNLP 2022 paper - The Devil in Linear Transformer
  ☆61Updated 2 years ago
• invictus717 / MiCo
  [ICCV'25] Explore the Limits of Omni-modal Pretraining at Scale
  ☆114Updated 11 months ago
• lucasjinreal / ImageTokenizer
  imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…
  ☆35Updated last year
• yyyyychen / LowMemoryBP
  The official implementation of the paper "Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing Backpropagation"
  ☆20Updated 8 months ago
• BriansIDP / video-SALMONN-o1
  ☆33Updated 2 months ago
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆209Updated 7 months ago
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆48Updated last month
• emova-ollm / EMOVA
  Official PyTorch implementation of EMOVA in CVPR 2025 (https://arxiv.org/abs/2409.18042)
  ☆61Updated 4 months ago