Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Zeta
☆130Oct 26, 2026Updated 2 weeks ago
Alternatives and similar repositories for MoE-Mamba
Users that are interested in MoE-Mamba are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation of MambaByte in "MambaByte: Token-free Selective State Space Model" in Pytorch and Zeta☆129Oct 26, 2026Updated 2 weeks ago
- Mamba R1 represents a novel architecture that combines the efficiency of Mamba's state space models with the scalability of Mixture of Ex…☆26Oct 13, 2025Updated last year
- Implementation of VisionLLaMA from the paper: "VisionLLaMA: A Unified LLaMA Interface for Vision Tasks" in PyTorch and Zeta☆15Nov 11, 2024Updated last year
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆32Oct 26, 2026Updated 2 weeks ago
- A swarm of LLM agents that will help you test, document, and productionize your code!☆20Oct 26, 2026Updated 2 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling☆231Oct 26, 2026Updated 2 weeks ago
- A framework for time series modeling using adaptive expertise.☆12Aug 30, 2024Updated 2 years ago
- Welcome to AGI, the cutting-edge project dedicated to building the core components of Artificial General Intelligence.☆18Nov 2, 2026Updated last week
- Implementation of Vision Mamba from the paper: "Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Mod…☆496Oct 26, 2026Updated 2 weeks ago
- [WACV 2025] Cross-Task Affinity Learning for Multitask Dense Scene Predictions☆11Jun 12, 2025Updated last year
- Implementation of a Hierarchical Mamba as described in the paper: "Hierarchical State Space Models for Continuous Sequence-to-Sequence Mo…☆16Nov 11, 2024Updated last year
- A forest of autonomous agents.☆20Jan 27, 2025Updated last year
- A simple and efficient Mamba implementation in pure PyTorch and MLX.☆1,485May 3, 2026Updated 6 months ago
- Simple Implementation of TinyGPTV in super simple Zeta lego blocks☆16Nov 11, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆26Oct 26, 2026Updated 2 weeks ago
- Official PyTorch Implementation of "The Hidden Attention of Mamba Models"☆238Oct 16, 2025Updated last year
- OpioidRL is a cutting-edge reinforcement learning (RL) library that simulates drug addiction behaviors within RL agents. Inspired by the …☆11Oct 26, 2026Updated 2 weeks ago
- A simpler Pytorch + Zeta Implementation of the paper: "SiMBA: Simplified Mamba-based Architecture for Vision and Multivariate Time series…☆29Nov 11, 2024Updated last year
- An efficient pytorch implementation of selective scan in one file, works with both cpu and gpu, with corresponding mathematical derivatio…☆108Oct 14, 2025Updated last year
- Awesome Papers related to Mamba.☆1,402Oct 17, 2024Updated 2 years ago
- Implementation of the Mamba SSM with hf_integration.☆56Aug 31, 2024Updated 2 years ago
- Implementation of PyTorch: "GAMBA: MARRY GAUSSIAN SPLATTING WITH MAMBA FOR SINGLE-VIEW 3D RECONSTRUCTION"☆65Oct 6, 2025Updated last year
- Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆124Oct 26, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Implementation of the "the first large-scale multimodal mixture of experts models." from the paper: "Multimodal Contrastive Learning with…☆36Nov 2, 2026Updated last week
- [EMNLP2024] Rethinking Token Reduction for State Space Models☆11Dec 7, 2024Updated last year
- ICCV 2019 Tutorial: Global Optimization for Geometric Understanding with Provable Guarantees☆15Oct 20, 2022Updated 4 years ago
- Implementation of a modular, high-performance, and simplistic mamba for high-speed applications☆41Nov 11, 2024Updated last year
- [TMLR] Offical Implementation of ToMoE: ToMoE: Converting Dense Large Language Models to Mixture-of-Experts through Dynamic Structural Pr…☆42Aug 27, 2026Updated 2 months ago
- A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest…☆473Nov 2, 2026Updated last week
- Collect papers about Mamba (a selective state space model).☆15Aug 6, 2024Updated 2 years ago
- CRAI is a multimodal large language model based on the Mixture of Experts (MoE) architecture, supporting text and image cross-modal tasks…☆16Apr 29, 2025Updated last year
- Mamba-Chat: A chat LLM based on the state-space model architecture 🐍☆942Mar 3, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- [ICML 2025] Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"☆19Mar 10, 2025Updated last year
- Implementation of Liquid Nets in Pytorch☆72Oct 26, 2026Updated 2 weeks ago
- Simple, minimal implementation of the Mamba SSM in one file of PyTorch.☆2,969Mar 8, 2024Updated 2 years ago
- CogNetX is an advanced, multimodal neural network architecture inspired by human cognition. It integrates speech, vision, and video proce…☆22Oct 26, 2026Updated 2 weeks ago
- Build high-performance AI models with modular building blocks☆605Updated this week
- Inference of Mamba, Mamba2 and Mamba3 models in pure C☆204Mar 18, 2026Updated 7 months ago
- Thesis project about Visual Anomaly Detection based on Self Supervised Learning. The model identifies anomalies from information acquired…☆11Apr 14, 2023Updated 3 years ago
Are these results useful?