FoundationVision / OmniTokenizer
[NeurIPS 2024]OmniTokenizer: one model and one weight for image-video joint tokenization.
☆279Updated 7 months ago
Alternatives and similar repositories for OmniTokenizer:
Users that are interested in OmniTokenizer are comparing it to the libraries listed below
- a family of versatile and state-of-the-art video tokenizers.☆337Updated last month
- ☆131Updated last month
- Evaluating text-to-image/video/3D models with VQAScore☆253Updated last week
- Visualization of DiT self attention features☆167Updated 6 months ago
- [ICLR 2025] MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆289Updated this week
- SaRA: High-Efficient Diffusion Model Fine-tuning with Progressive Sparse Low-Rank Adaptation☆107Updated 4 months ago
- [NeurIPS 2024 D&B Spotlight🔥] ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generation☆179Updated last week
- [CVPR 2024] Focus on Your Instruction: Fine-grained and Multi-instruction Image Editing by Attention Modulation☆109Updated 11 months ago
- [ICLR 2025] BiGR: Harnessing Binary Latent Codes for Image Generation and Improved Visual Representation Capabilities☆138Updated 3 weeks ago
- 🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".☆253Updated last month
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".☆236Updated last month
- Scaling Diffusion Transformers with Mixture of Experts☆260Updated 5 months ago
- Official implementation of X-Prompt: Towards Universal In-Context Image Generation in Auto-Regressive Vision Language Foundation Models☆154Updated 2 months ago
- (ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generator☆104Updated 4 months ago
- The code for "VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM"☆145Updated this week
- [ICLR 2025] OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generation☆243Updated last week
- Official implementation for "Identifying and Solving Conditional Image Leakage in Image-to-Video Diffusion Model" (NeurIPS 2024)☆247Updated 3 months ago
- [ICLR 2025] Autoregressive Video Generation without Vector Quantization☆388Updated this week
- ☆139Updated 2 months ago
- This is a repo to track the latest autoregressive visual generation papers.☆143Updated this week
- [ECCV 2024] Bridging Different Language Models and Generative Vision Models for Text-to-Image Generation☆290Updated 7 months ago
- Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition☆276Updated last month
- [NeurIPS 2024] CV-VAE: A Compatible Video VAE for Latent Generative Video Models☆262Updated 2 months ago
- ☆189Updated last week
- [ICLR25] High-performance Image Tokenizers for VAR and AR☆200Updated last week
- MoVQGAN - model for the image encoding and reconstruction☆218Updated last year
- [ICLR2024] The official implementation of paper "VDT: General-purpose Video Diffusion Transformers via Mask Modeling", by Haoyu Lu, Guoxi…☆228Updated 9 months ago
- Official code base for paper EZIGen: Enhancing zero-shot personalized image generation with precise subject encoding and decoupled guidan…☆102Updated last week
- Quick scripts to calculate CLIP text-image similarity☆213Updated 2 months ago