Implementation of the "the first large-scale multimodal mixture of experts models." from the paper: "Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts"
☆36Nov 2, 2026Updated last week
Alternatives and similar repositories for LIMoE
Users that are interested in LIMoE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PyTorch implementation of LIMoE☆52Apr 1, 2024Updated 2 years ago
- Solving Token Gradient Conflict in Mixture-of-Experts for Large Vision-Language Model☆13Feb 11, 2025Updated last year
- A swarm of LLM agents that will help you test, document, and productionize your code!☆20Oct 26, 2026Updated 2 weeks ago
- This repository contains the code for the paper "ST-MoE-BERT: A Spatial-Temporal Mixture-of-Experts Framework for Long-Term Cross-City Mo…☆17Feb 20, 2025Updated last year
- HydraNet is a state-of-the-art transformer architecture that combines Multi-Query Attention (MQA), Mixture of Experts (MoE), and continuo…☆14Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Community Implementation of the paper: "Multi-Head Mixture-of-Experts" In PyTorch☆31Oct 26, 2026Updated 2 weeks ago
- Zeta implemantion of "Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Trans…☆12Updated this week
- OpioidRL is a cutting-edge reinforcement learning (RL) library that simulates drug addiction behaviors within RL agents. Inspired by the …☆11Oct 26, 2026Updated 2 weeks ago
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆27Nov 11, 2024Updated 2 years ago
- Multi-Agent Template App☆11Oct 26, 2026Updated 2 weeks ago
- OmniByteFormer is a generalized Transformer model that can process any type of data by converting it into byte sequences, bypassing tradi…☆17Updated this week
- Implementation of "Audio xLSTMs: Learning Self-supervised audio representations with xLSTMs" in PyTorch☆20Oct 26, 2026Updated 2 weeks ago
- The official implement of "Routing Experts: Learning to Route Dynamic Experts in Existing Multi-modal Large Language Models"☆17Mar 24, 2025Updated last year
- CRAI is a multimodal large language model based on the Mixture of Experts (MoE) architecture, supporting text and image cross-modal tasks…☆16Apr 29, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- CogNetX is an advanced, multimodal neural network architecture inspired by human cognition. It integrates speech, vision, and video proce…☆22Oct 26, 2026Updated 2 weeks ago
- Mamba R1 represents a novel architecture that combines the efficiency of Mamba's state space models with the scalability of Mixture of Ex…☆26Oct 13, 2025Updated last year
- Pytorch implementation of HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models☆28Mar 22, 2024Updated 2 years ago
- Transformers + Mambas + LSTMS All in One Model☆15Oct 26, 2026Updated 2 weeks ago
- A text-to-SQL prototype on the northwind sqlite dataset☆13Sep 24, 2024Updated 2 years ago
- [CVPR 2025] CL-MoE: Enhancing Multimodal Large Language Model with Dual Momentum Mixture-of-Experts for Continual Visual Question Answeri…☆63Jun 16, 2025Updated last year
- Codes for Hierarchical Time-Aware Mixture of Experts for Multi-Modal Sequential Recommendation (WWW2025)☆37Jun 17, 2025Updated last year
- Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch☆29Oct 26, 2026Updated 2 weeks ago
- The official implementation of "MoCaE: Mixture of Calibrated Experts Significantly Improves Accuracy in Object Detection"☆46Mar 25, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆32Oct 26, 2026Updated 2 weeks ago
- The source code for WebConf 2025 paper "Multimodal Graph-Based Variational Mixture of Experts Network for Zero-Shot Multimodal Informatio…☆11Feb 17, 2025Updated last year
- ☆11Jun 16, 2026Updated 4 months ago
- ☆11Sep 16, 2025Updated last year
- Scaling Laws for Mixture of Experts Models☆16Feb 25, 2025Updated last year
- Implementation of MambaFormer in Pytorch ++ Zeta from the paper: "Can Mamba Learn How to Learn? A Comparative Study on In-Context Learnin…☆23Nov 2, 2026Updated last week
- Pytorch Implementation of the paper: "Learning to (Learn at Test Time): RNNs with Expressive Hidden States"☆24Oct 26, 2026Updated 2 weeks ago
- A forest of autonomous agents.☆20Jan 27, 2025Updated last year
- Implementation of the paper: "Aurora: A Foundation Model of the Atmosphere" in PyTorch☆24Oct 26, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models☆165Jul 9, 2025Updated last year
- Welcome to AGI, the cutting-edge project dedicated to building the core components of Artificial General Intelligence.☆18Updated this week
- Automation tool that follows GitHub users based on smart algorithms to analyze behavior and increase chances of getting follow-backs.☆13Feb 7, 2026Updated 9 months ago
- ☆12Sep 28, 2024Updated 2 years ago
- [ICML 2025] Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"☆19Mar 10, 2025Updated last year
- TAMER: Interest Tree Augmented Modality Graph Recommender for Multimodal Recommendation☆12Aug 5, 2026Updated 3 months ago
- A simple and minimal open source implementation of "Introducing LFM2: The Fastest On-Device Foundation Models on the Market" from Liquid …☆34Oct 26, 2026Updated 2 weeks ago
Are these results useful?