Implementation of the "the first large-scale multimodal mixture of experts models." from the paper: "Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts"
☆36Oct 10, 2026Updated last week
Alternatives and similar repositories for LIMoE
Users that are interested in LIMoE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- OpioidRL is a cutting-edge reinforcement learning (RL) library that simulates drug addiction behaviors within RL agents. Inspired by the …☆11Updated this week
- OmniByteFormer is a generalized Transformer model that can process any type of data by converting it into byte sequences, bypassing tradi…☆17Updated this week
- Implementation of "Audio xLSTMs: Learning Self-supervised audio representations with xLSTMs" in PyTorch☆20Oct 12, 2026Updated last week
- Community Implementation of the paper: "Multi-Head Mixture-of-Experts" In PyTorch☆31Oct 9, 2026Updated 2 weeks ago
- Zeta implemantion of "Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Trans…☆12Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Welcome to AGI, the cutting-edge project dedicated to building the core components of Artificial General Intelligence.☆18Oct 14, 2026Updated last week
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆27Nov 11, 2024Updated last year
- Mamba R1 represents a novel architecture that combines the efficiency of Mamba's state space models with the scalability of Mixture of Ex…☆26Oct 13, 2025Updated last year
- CRAI is a multimodal large language model based on the Mixture of Experts (MoE) architecture, supporting text and image cross-modal tasks…☆16Apr 29, 2025Updated last year
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆32Oct 14, 2026Updated last week
- A forest of autonomous agents.☆20Jan 27, 2025Updated last year
- Pytorch Implementation of the paper: "Learning to (Learn at Test Time): RNNs with Expressive Hidden States"☆24Oct 13, 2026Updated last week
- ☆12Jul 21, 2023Updated 3 years ago
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆26Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Pytorch implementation of HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models☆28Mar 22, 2024Updated 2 years ago
- Transformers + Mambas + LSTMS All in One Model☆15Oct 13, 2026Updated last week
- Solving Token Gradient Conflict in Mixture-of-Experts for Large Vision-Language Model☆13Feb 11, 2025Updated last year
- The code of 《M4: Multi-Proxy Multi-Gate Mixture of Experts Network for Multiple Instance Learning in Histopathology Image Analysis》☆14Mar 31, 2025Updated last year
- Codes for Hierarchical Time-Aware Mixture of Experts for Multi-Modal Sequential Recommendation (WWW2025)☆35Jun 17, 2025Updated last year
- A Reliable, Customize-able, and Scalable Zapier Alternative for Production-Grade Workflow Automation☆14Nov 11, 2024Updated last year
- The next evolution of Agents☆49Oct 9, 2026Updated 2 weeks ago
- Implementation of M2PT in PyTorch from the paper: "Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities"☆14Mar 11, 2024Updated 2 years ago
- Implementation of MambaFormer in Pytorch ++ Zeta from the paper: "Can Mamba Learn How to Learn? A Comparative Study on In-Context Learnin…☆23Oct 14, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Zeta implementation of a reusable and plug in and play feedforward from the paper "Exponentially Faster Language Modeling"☆16Nov 11, 2024Updated last year
- Scaling Laws for Mixture of Experts Models☆16Feb 25, 2025Updated last year
- Implementation of the paper: "Aurora: A Foundation Model of the Atmosphere" in PyTorch☆24Oct 14, 2026Updated last week
- Mixture-of-Experts Multimodal Variational Autoencoder☆15Jul 3, 2025Updated last year
- ☆12Jul 28, 2023Updated 3 years ago
- A sophisticated multi-agent system designed for real-time market analysis of HTX (formerly Huobi) exchange data. This swarm combines spec…☆11Mar 18, 2025Updated last year
- Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …☆15Mar 11, 2024Updated 2 years ago
- Community Open Source Implementation of GPT4o in PyTorch☆33Oct 12, 2026Updated last week
- BeFA: A General Behavior-driven Feature Adapter for Multimedia Recommendation☆13Feb 21, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…☆18Oct 13, 2025Updated last year
- Implementation of Google's USM speech model in Pytorch☆36Oct 9, 2026Updated 2 weeks ago
- Automation tool that follows GitHub users based on smart algorithms to analyze behavior and increase chances of getting follow-backs.☆13Feb 7, 2026Updated 8 months ago
- Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Ze…☆131Oct 10, 2026Updated last week
- MMoE: Multimodal Mixture-of-Experts (EMNLP 2024)☆16Nov 14, 2024Updated last year
- Brainwave is a state-of-the-art neural decoder that transforms electroencephalogram (EEG) and brain signals into multimodal outputs inclu…☆14Oct 6, 2025Updated last year
- MoE-Visualizer is a tool designed to visualize the selection of experts in Mixture-of-Experts (MoE) models.☆16Apr 8, 2025Updated last year