Agora-Lab-AI / OmegaViTLinks
OmegaViT (ΩViT) is a cutting-edge vision transformer architecture that combines multi-query attention, rotary embeddings, state space modeling, and mixture of experts to achieve superior performance across various computer vision tasks.
☆14Updated 3 weeks ago
Alternatives and similar repositories for OmegaViT
Users that are interested in OmegaViT are comparing it to the libraries listed below
Sorting:
- BH hackathon☆14Updated last year
- ☆10Updated last month
- alternative way to calculating self attention☆18Updated last year
- The original BabyAGI, updated with LiteLLM and no vector database reliance (csv instead)☆21Updated 8 months ago
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆22Updated 6 months ago
- ☆14Updated last year
- Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta☆13Updated 7 months ago
- Implementation of Spectral State Space Models☆16Updated last year
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆29Updated last week
- Lego for GRPO☆28Updated 3 weeks ago
- ☆13Updated 6 months ago
- ☆16Updated 3 months ago
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.☆20Updated last year
- Modified Beam Search with periodical restart☆12Updated 9 months ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆37Updated last year
- ☆20Updated 3 weeks ago
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- A forest of autonomous agents.☆19Updated 4 months ago
- Visual RAG using less than 300 lines of code.☆28Updated last year
- A framework making it effortless to convert any llm model into a reasoning agent like o1 or DeepSeek's r1☆21Updated 3 weeks ago
- A list of language models with permissive licenses such as MIT or Apache 2.0☆24Updated 3 months ago
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆17Updated 3 months ago
- Official implementation of ECCV24 paper: POA☆24Updated 10 months ago
- A simple package for leveraging Falcon 180B and the HF ecosystem's tools, including training/inference scripts, safetensors, integrations…☆13Updated last year
- AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…☆13Updated 3 weeks ago
- Tiktok is an advanced multimedia recommender system that fuses the generative modality-aware collaborative self-augmentation and contrast…☆13Updated last year
- Transform unstructured documents into actionable, structured data with enterprise-grade precision and reliability, ready for large-scale …☆19Updated 3 weeks ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- Repository to create traveling waves integrate special information through time☆52Updated 3 months ago
- ☆38Updated 10 months ago