naver-ai / rope-vit
[ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"
☆217Updated 3 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for rope-vit
- Open source implementation of "Vision Transformers Need Registers"☆143Updated last week
- When do we not need larger vision models?☆336Updated last week
- Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch☆248Updated 6 months ago
- My implementation of "Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution"☆185Updated last week
- unofficial MaskGIT reproduction in PyTorch☆165Updated 9 months ago
- The official repo for [TPAMI'23] "Vision Transformer with Quadrangle Attention"☆179Updated 7 months ago
- This repo contains the code for 1D tokenizer and generator☆554Updated this week
- An efficient pytorch implementation of selective scan in one file, works with both cpu and gpu, with corresponding mathematical derivatio…☆71Updated 8 months ago
- ☆104Updated 4 months ago
- Official Pytorch Implementation of Our CVPR2023 Paper: "Towards Accurate Image Coding: Improved Autoregressive Image Generation with Dyna…☆156Updated last year
- 1.5−3.0× lossless training or pre-training speedup. An off-the-shelf, easy-to-implement algorithm for the efficient training of foundatio…☆209Updated 3 months ago
- [NeurIPS 2024] Classification Done Right for Vision-Language Pre-Training☆135Updated 2 weeks ago
- 🔥stable, simple, state-of-the-art VQVAE toolkit & cookbook☆42Updated 5 months ago
- Object Recognition as Next Token Prediction (CVPR 2024 Highlight)☆161Updated last month
- A simple minimal implementation of Reversible Vision Transformers☆117Updated 8 months ago
- [CVPR'24] Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities☆94Updated 8 months ago
- Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"☆103Updated 3 months ago
- [CVPR 2024] Official implementation of "ViTamin: Designing Scalable Vision Models in the Vision-language Era"☆179Updated 5 months ago
- Implementation of a single layer of the MMDiT, proposed in Stable Diffusion 3, in Pytorch☆256Updated 2 months ago
- The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss". A su…☆181Updated 3 weeks ago
- Official implementation of the Law of Vision Representation in MLLMs☆134Updated this week
- A Pytorch Implementation of Finite Scalar Quantization☆88Updated 11 months ago
- MoVQGAN - model for the image encoding and reconstruction☆201Updated last year
- [NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models☆232Updated last month
- This is the official code release for our work, Denoising Vision Transformers.☆319Updated last week
- Code for Fast Training of Diffusion Models with Masked Transformers☆375Updated 6 months ago
- [ICML 2024] This repository includes the official implementation of our paper "Rejuvenating image-GPT as Strong Visual Representation Lea…☆98Updated 6 months ago
- A PyTorch implementation of the paper "ZigMa: A DiT-Style Mamba-based Diffusion Model" (ECCV 2024)☆276Updated this week
- A collection of resources and papers on Vector Quantized Variational Autoencoder (VQ-VAE) and its application☆221Updated 7 months ago
- [ICLR 2024 (Spotlight)] "Frozen Transformers in Language Models are Effective Visual Encoder Layers"☆225Updated 10 months ago