lucasjinreal / LLaVA-Magvit2
LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.
☆35Updated 9 months ago
Alternatives and similar repositories for LLaVA-Magvit2:
Users that are interested in LLaVA-Magvit2 are comparing it to the libraries listed below
- LMM solved catastrophic forgetting, AAAI2025☆40Updated this week
- HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation☆54Updated 2 months ago
- minisora-DiT, a DiT reproduction based on XTuner from the open source community MiniSora☆41Updated last year
- ACDiT: Interpolating Autoregressive Conditional Modeling and Diffusion Transformer☆31Updated 3 months ago
- Video dataset dedicated to portrait-mode video recognition.☆48Updated 4 months ago
- The official PyTorch implementation for Improving Long-Text Alignment for Text-to-Image Diffusion Models (LongAlign)☆69Updated 6 months ago
- The official implementation of OmniFlow: Any-to-Any Generation with Multi-Modal Rectified Flows☆56Updated last month
- The official repo of continuous speculative decoding☆24Updated 3 weeks ago
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆42Updated 9 months ago
- Our 2nd-gen LMM☆33Updated 10 months ago
- A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.☆34Updated 9 months ago
- ☆11Updated last month
- ☆28Updated last year
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆90Updated this week
- [PR 2024] A large Cross-Modal Video Retrieval Dataset with Reading Comprehension☆26Updated last year
- ECCV2024_Parrot Captions Teach CLIP to Spot Text☆65Updated 7 months ago
- T2VScore: Towards A Better Metric for Text-to-Video Generation☆80Updated last year
- MIO: A Foundation Model on Multimodal Tokens☆25Updated 4 months ago
- [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective☆66Updated 5 months ago
- Unifying Visual Understanding and Generation with Dual Visual Vocabularies 🌈☆37Updated 3 weeks ago
- imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…☆33Updated 9 months ago
- A project for tri-modal LLM benchmarking and instruction tuning.☆29Updated 3 weeks ago
- Codebase for the paper-Elucidating the design space of language models for image generation☆45Updated 5 months ago
- Minimal Differentiable Image Reward Functions☆53Updated this week
- Multimodal Open-O1 (MO1) is designed to enhance the accuracy of inference models by utilizing a novel prompt-based approach. This tool wo…☆29Updated 6 months ago
- A light-weight and high-efficient training framework for accelerating diffusion tasks.☆46Updated 7 months ago
- Inference-only implementation of "One-Step Diffusion Distillation through Score Implicit Matching" [NIPS 2024]☆79Updated 5 months ago
- This is the official repo for ByteVideoLLM/Dynamic-VLM☆20Updated 4 months ago
- Code for the paper "Vamba: Understanding Hour-Long Videos with Hybrid Mamba-Transformers"☆60Updated last month
- A Simple Framework of Small-scale LMMs for Video Understanding☆47Updated this week