Agora-Lab-AI / OmegaViT

OmegaViT (ΩViT) is a cutting-edge vision transformer architecture that combines multi-query attention, rotary embeddings, state space modeling, and mixture of experts to achieve superior performance across various computer vision tasks.
12Updated this week

Alternatives and similar repositories for OmegaViT:

Users that are interested in OmegaViT are comparing it to the libraries listed below