My implementation of "Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution"
☆273Aug 3, 2026Updated last week
Alternatives and similar repositories for NaViT
Users that are interested in NaViT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- My implementation of the model KosmosG from "KOSMOS-G: Generating Images in Context with Multimodal Large Language Models"☆13Nov 11, 2024Updated last year
- Official repo for paper "MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captions"☆527Sep 2, 2024Updated last year
- LLaVA-UHD v3: Progressive Visual Compression for Efficient Native-Resolution Encoding in MLLMs☆423Jul 6, 2026Updated last month
- A bug-free and improved implementation of LLaVA-UHD, based on the code from the official repo☆35Aug 12, 2024Updated 2 years ago
- Implementation of MagViT2 Tokenizer in Pytorch☆668Jan 12, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- VideoSys: An easy and efficient system for video generation☆2,022Aug 27, 2025Updated 11 months ago
- ☆365Jan 27, 2024Updated 2 years ago
- Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"☆8,692May 31, 2024Updated 2 years ago
- SEED-Voken: A Series of Powerful Visual Tokenizers☆1,020Nov 25, 2025Updated 8 months ago
- [TMLR 2025] Latte: Latent Diffusion Transformer for Video Generation.☆1,948Updated this week
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆376Jul 24, 2025Updated last year
- INF-LLaVA: Dual-perspective Perception for High-Resolution Multimodal Large Language Model☆42Aug 4, 2024Updated 2 years ago
- ☆4,714Jun 15, 2026Updated 2 months ago
- The open source implementation of the multi grouped query attention by the paper "GQA: Training Generalized Multi-Query Transformer Model…☆17Dec 11, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The official GitHub page for the review paper "Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision M…☆504Mar 21, 2024Updated 2 years ago
- Cambrian-1 is a family of multimodal LLMs with a vision-centric design.☆2,014Nov 7, 2025Updated 9 months ago
- When do we not need larger vision models?☆419Feb 8, 2025Updated last year
- Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"☆147Aug 3, 2026Updated last week
- Stable Video Diffusion Training Code and Extensions.☆731Jul 25, 2024Updated 2 years ago
- Next-Token Prediction is All You Need☆2,437Jan 12, 2026Updated 7 months ago
- ☆1,264Nov 20, 2025Updated 8 months ago
- Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.☆3,515May 19, 2025Updated last year
- Unofficial implementation of DocMAE (WIP): Document Image Rectification via Self-supervised Representation Learning☆20Dec 20, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ICML 2024 Spotlight] FiT: Flexible Vision Transformer for Diffusion Model☆435Nov 10, 2024Updated last year
- Official implementation of the paper "Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Vi…☆255Mar 19, 2025Updated last year
- Trying to implement https://arxiv.org/abs/2305.08891☆35Jun 10, 2023Updated 3 years ago
- Official JAX implementation of MAGVIT: Masked Generative Video Transformer☆1,002Jan 17, 2024Updated 2 years ago
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM", IJCV2025☆279May 26, 2025Updated last year
- ☆11Jun 28, 2024Updated 2 years ago
- SVIT: Scaling up Visual Instruction Tuning☆168Jun 20, 2024Updated 2 years ago
- Implementation of the model from "Faster sorting algorithms discovered using deep reinforcement learning" that discovered an all-new ult…☆11Aug 29, 2023Updated 2 years ago
- Masked Diffusion Transformer is the SOTA for image synthesis. (ICCV 2023)☆596Apr 23, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- MoVQGAN - model for the image encoding and reconstruction☆266Oct 31, 2023Updated 2 years ago
- [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型☆10,130Sep 22, 2025Updated 10 months ago
- 【NeurIPS 2024】Dense Connector for MLLMs☆182Oct 14, 2024Updated last year
- Seed1.5-VL, a vision-language foundation model designed to advance general-purpose multimodal understanding and reasoning, achieving stat…☆1,583Jun 14, 2025Updated last year
- PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis☆3,302Oct 31, 2024Updated last year
- LaVIT: Empower the Large Language Model to Understand and Generate Visual Content☆604Oct 6, 2024Updated last year
- LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.☆38Jun 20, 2024Updated 2 years ago