FoundationVision / OmniTokenizer
[NeurIPS 2024]OmniTokenizer: one model and one weight for image-video joint tokenization.
☆293Updated 10 months ago
Alternatives and similar repositories for OmniTokenizer:
Users that are interested in OmniTokenizer are comparing it to the libraries listed below
- Official repository of T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT☆79Updated last week
- a family of versatile and state-of-the-art video tokenizers.☆382Updated last month
- Visualization of DiT self attention features☆205Updated 8 months ago
- ☆135Updated 4 months ago
- Evaluating text-to-image/video/3D models with VQAScore☆293Updated last month
- SaRA: High-Efficient Diffusion Model Fine-tuning with Progressive Sparse Low-Rank Adaptation☆114Updated 6 months ago
- [ICLR 2025] MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆303Updated 2 months ago
- Liquid: Language Models are Scalable and Unified Multi-modal Generators☆555Updated last month
- ☆104Updated 2 months ago
- GPT-ImgEval: Evaluating GPT-4o’s state-of-the-art image generation capabilities☆252Updated this week
- Pytorch implementation for the paper titled "SimpleAR: Pushing the Frontier of Autoregressive Visual Generation"☆333Updated 2 weeks ago
- High-performance Image Tokenizers for VAR and AR☆255Updated 2 weeks ago
- [CVPR 2025] 🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".☆318Updated 2 months ago
- [CVPR 2025] The First Investigation of CoT Reasoning in Image Generation☆651Updated last month
- [ICML 2025 Spotlight]An official implementation of VideoRoPE: What Makes for Good Video Rotary Position Embedding?☆139Updated 2 weeks ago
- [CVPR2025 Highlight] PAR: Parallelized Autoregressive Visual Generation. https://yuqingwang1029.github.io/PAR-project☆151Updated last month
- [ICLR 2025] Autoregressive Video Generation without Vector Quantization☆492Updated 2 weeks ago
- Implements VAR+CLIP for text-to-image (T2I) generation☆136Updated 3 months ago
- [CVPR 2024] Focus on Your Instruction: Fine-grained and Multi-instruction Image Editing by Attention Modulation☆112Updated last year
- Scaling Diffusion Transformers with Mixture of Experts☆317Updated 8 months ago
- [ICLR 2025] OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generation☆288Updated 2 months ago
- Official implementation of Unified Reward Model for Multimodal Understanding and Generation.☆243Updated this week
- This repository includes the official implementation of our paper "Beyond Next-Token: Next-X Prediction for Autoregressive Visual Generat…☆199Updated last week
- VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generation☆232Updated last month
- ☆159Updated 4 months ago
- Official implementation of the paper: REPA-E: Unlocking VAE for End-to-End Tuning of Latent Diffusion Transformers☆190Updated 3 weeks ago
- [ICLR 2025] Diffusion Feedback Helps CLIP See Better☆277Updated 3 months ago
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".☆246Updated 4 months ago
- Official implementation for "Identifying and Solving Conditional Image Leakage in Image-to-Video Diffusion Model" (NeurIPS 2024)☆250Updated 2 weeks ago
- [ECCV 2024] Bridging Different Language Models and Generative Vision Models for Text-to-Image Generation☆290Updated 9 months ago