Agora-Lab-AI / OmegaViT
OmegaViT (ΩViT) is a cutting-edge vision transformer architecture that combines multi-query attention, rotary embeddings, state space modeling, and mixture of experts to achieve superior performance across various computer vision tasks.
☆14Updated last week
Alternatives and similar repositories for OmegaViT:
Users that are interested in OmegaViT are comparing it to the libraries listed below
- BH hackathon☆14Updated last year
- A list of language models with permissive licenses such as MIT or Apache 2.0☆24Updated last month
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆29Updated this week
- ☆16Updated 6 months ago
- alternative way to calculating self attention☆18Updated 10 months ago
- The original BabyAGI, updated with LiteLLM and no vector database reliance (csv instead)☆21Updated 6 months ago
- A forest of autonomous agents.☆19Updated 2 months ago
- Modified Beam Search with periodical restart☆12Updated 7 months ago
- ☆14Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…☆13Updated last week
- ☆16Updated last month
- Tiktok is an advanced multimedia recommender system that fuses the generative modality-aware collaborative self-augmentation and contrast…☆12Updated last year
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆37Updated 10 months ago
- A framework making it effortless to convert any llm model into a reasoning agent like o1 or DeepSeek's r1☆20Updated this week
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆39Updated 2 months ago
- Transform unstructured documents into actionable, structured data with enterprise-grade precision and reliability, ready for large-scale …☆19Updated last week
- Proteus is an experimental platform that combines the power of Large Language Models with the Genesis physics engine☆21Updated 3 months ago
- ☆13Updated 4 months ago
- The world's first fully automated VC fund.☆20Updated last week
- Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]☆18Updated last month
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- ☆21Updated 5 months ago
- MPI Code Generation through Domain-Specific Language Models☆13Updated 4 months ago
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆17Updated 3 weeks ago
- Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta☆13Updated 5 months ago
- Implementation of Spectral State Space Models☆16Updated last year
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆19Updated 6 months ago
- NewsAgent is an enterprise-grade news aggregation agent designed to fetch, query, and summarize news from multiple sources at scale.☆16Updated last week
- Repository to create traveling waves integrate special information through time☆50Updated last month