lucasjinreal / LLaVA-Magvit2
LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.
☆38Updated 10 months ago
Alternatives and similar repositories for LLaVA-Magvit2
Users that are interested in LLaVA-Magvit2 are comparing it to the libraries listed below
Sorting:
- LMM solved catastrophic forgetting, AAAI2025☆42Updated 3 weeks ago
- HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation☆57Updated 2 months ago
- minisora-DiT, a DiT reproduction based on XTuner from the open source community MiniSora☆41Updated last year
- ☆29Updated 8 months ago
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆42Updated 10 months ago
- Ming - facilitating advanced multimodal understanding and generation capabilities built upon the Ling LLM.☆66Updated this week
- Video dataset dedicated to portrait-mode video recognition.☆48Updated 5 months ago
- imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…☆34Updated 10 months ago
- A light-weight and high-efficient training framework for accelerating diffusion tasks.☆47Updated 7 months ago
- The official implementation of OmniFlow: Any-to-Any Generation with Multi-Modal Rectified Flows☆58Updated 2 months ago
- A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.☆35Updated 10 months ago
- ACDiT: Interpolating Autoregressive Conditional Modeling and Diffusion Transformer☆33Updated 4 months ago
- Inference-only implementation of "One-Step Diffusion Distillation through Score Implicit Matching" [NIPS 2024]☆81Updated 5 months ago
- T2VScore: Towards A Better Metric for Text-to-Video Generation☆80Updated last year
- The official PyTorch implementation for Improving Long-Text Alignment for Text-to-Image Diffusion Models (LongAlign)☆73Updated 3 weeks ago
- Minimal Differentiable Image Reward Functions☆55Updated last month
- ☆75Updated 2 months ago
- MIO: A Foundation Model on Multimodal Tokens☆25Updated 5 months ago
- [CVPR 2025 AI4CC Workshop] Official Implementation of HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editin…☆28Updated this week
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆99Updated 3 weeks ago
- Our 2nd-gen LMM☆33Updated 11 months ago
- The official repository for the RealSyn dataset☆32Updated 2 weeks ago
- A Dead Simple and Modularized Multi-Modal Training and Finetune Framework. Compatible to any LLaVA/Flamingo/QwenVL/MiniGemini etc series …☆19Updated last year
- Keras implement of Finite Scalar Quantization☆71Updated last year
- Codebase for the paper-Elucidating the design space of language models for image generation☆45Updated 5 months ago
- ☆28Updated last year
- ☆69Updated last week
- TIP-I2V: A Million-Scale Real Text and Image Prompt Dataset for Image-to-Video Generation☆30Updated 5 months ago
- ☆11Updated 2 months ago
- Unifying Visual Understanding and Generation with Dual Visual Vocabularies 🌈☆43Updated 3 weeks ago