lucasjinreal / LLaVA-Magvit2Links
LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.
☆37Updated 11 months ago
Alternatives and similar repositories for LLaVA-Magvit2
Users that are interested in LLaVA-Magvit2 are comparing it to the libraries listed below
Sorting:
- minisora-DiT, a DiT reproduction based on XTuner from the open source community MiniSora☆41Updated last year
- LMM solved catastrophic forgetting, AAAI2025☆43Updated last month
- ACDiT: Interpolating Autoregressive Conditional Modeling and Diffusion Transformer☆33Updated 5 months ago
- imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…☆34Updated 11 months ago
- HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation☆62Updated 3 months ago
- Video dataset dedicated to portrait-mode video recognition.☆49Updated 5 months ago
- Inference-only implementation of "One-Step Diffusion Distillation through Score Implicit Matching" [NIPS 2024]☆81Updated 6 months ago
- TokLIP: Marry Visual Tokens to CLIP for Multimodal Comprehension and Generation☆23Updated 3 weeks ago
- A light-weight and high-efficient training framework for accelerating diffusion tasks.☆47Updated 8 months ago
- Ming - facilitating advanced multimodal understanding and generation capabilities built upon the Ling LLM.☆107Updated this week
- TIP-I2V: A Million-Scale Real Text and Image Prompt Dataset for Image-to-Video Generation☆30Updated 6 months ago
- ☆29Updated 9 months ago
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆43Updated 11 months ago
- A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.☆35Updated 11 months ago
- MIO: A Foundation Model on Multimodal Tokens☆25Updated 5 months ago
- Code for the paper "Vamba: Understanding Hour-Long Videos with Hybrid Mamba-Transformers"☆66Updated 2 months ago
- ☆28Updated last year
- Codebase for the paper-Elucidating the design space of language models for image generation☆45Updated 6 months ago
- Multimodal Open-O1 (MO1) is designed to enhance the accuracy of inference models by utilizing a novel prompt-based approach. This tool wo…☆29Updated 8 months ago
- The official repository for the RealSyn dataset☆34Updated last month
- T2VScore: Towards A Better Metric for Text-to-Video Generation☆79Updated last year
- ☆11Updated 2 months ago
- The official PyTorch implementation for Improving Long-Text Alignment for Text-to-Image Diffusion Models (LongAlign)☆73Updated last month
- The official implementation of OmniFlow: Any-to-Any Generation with Multi-Modal Rectified Flows☆64Updated this week
- The official repo of continuous speculative decoding☆26Updated 2 months ago
- ☆17Updated last year
- LVAS-Agent Code Base☆17Updated last month
- Our 2nd-gen LMM☆33Updated last year
- [CVPR 2025 AI4CC Workshop] Official Implementation of HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editin…☆30Updated 3 weeks ago
- [ECCV'24 Oral] PiTe: Pixel-Temporal Alignment for Large Video-Language Model☆16Updated 3 months ago