kyegomez / qformerLinks
Implementation of Qformer from BLIP2 in Zeta Lego blocks.
☆47Updated last year
Alternatives and similar repositories for qformer
Users that are interested in qformer are comparing it to the libraries listed below
Sorting:
- Keras implement of Finite Scalar Quantization☆83Updated 2 years ago
- UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model☆22Updated last year
- Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"☆26Updated last year
- A project for tri-modal LLM benchmarking and instruction tuning.☆54Updated 10 months ago
- Official implementation for the paper "A Cheaper and Better Diffusion Language Model with Soft-Masked Noise"☆59Updated 2 years ago
- "Omni-R1: Towards the Unified Generative Paradigm for Multimodal Reasoning"☆35Updated this week
- [ICML 2025] Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalization☆106Updated 7 months ago
- MIO: A Foundation Model on Multimodal Tokens☆33Updated last year
- The official GitHub page for the survey paper "Discrete Tokenization for Multimodal LLMs: A Comprehensive Survey". And this paper is unde…☆77Updated 5 months ago
- ☆141Updated last year
- Implementation of a multimodal diffusion transformer in Pytorch☆107Updated last year
- Official code implementation for the work Preference Alignment with Flow Matching (NeurIPS 2024)☆65Updated last year
- EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning [🔥The Exploration of R1 for General Audio-Vi…☆72Updated 8 months ago
- LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.☆39Updated last year
- The open source implementation of the cross attention mechanism from the paper: "JOINTLY TRAINING LARGE AUTOREGRESSIVE MULTIMODAL MODELS"☆37Updated last year
- Repository for "TESS-2: A Large-Scale, Generalist Diffusion Language Model"☆54Updated 11 months ago
- Towards Fine-grained Audio Captioning with Multimodal Contextual Cues☆86Updated 3 weeks ago
- LMM solved catastrophic forgetting, AAAI2025☆45Updated 9 months ago
- ☆39Updated 5 months ago
- (NIPS 2025) OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Align…☆123Updated 2 months ago
- ☆19Updated last year
- ☆159Updated 9 months ago
- Explore how to get a VQ-VAE models efficiently!☆67Updated 6 months ago
- Implementation of the proposed MaskBit from Bytedance AI☆83Updated last year
- Implementation of the dynamic chunking mechanism in H-net by Hwang et al. of Carnegie Mellon☆66Updated 2 weeks ago
- Official PyTorch implementation of EMOVA in CVPR 2025 (https://arxiv.org/abs/2409.18042)☆76Updated 10 months ago
- The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"☆40Updated last year
- A repository for DenseSSMs☆88Updated last year
- The official implementation of MAGVLT: Masked Generative Vision-and-Language Transformer (CVPR'23)☆28Updated 2 years ago
- ☆76Updated 4 months ago