PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
☆223Oct 26, 2026Updated last week
Alternatives and similar repositories for Jamba
Users that are interested in Jamba are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆49Mar 31, 2024Updated 2 years ago
- Build high-performance AI models with modular building blocks☆605Oct 26, 2026Updated last week
- Implementation of MambaByte in "MambaByte: Token-free Selective State Space Model" in Pytorch and Zeta☆129Oct 26, 2026Updated last week
- Minimal Mamba-2 implementation in PyTorch☆259Jun 17, 2024Updated 2 years ago
- Mamba SSM architecture☆18,979Jul 22, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Simple, minimal implementation of the Mamba SSM in one file of PyTorch.☆2,969Mar 8, 2024Updated 2 years ago
- Code repository for Black Mamba☆265Feb 8, 2024Updated 2 years ago
- Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling☆230Oct 26, 2026Updated last week
- Implementation of MambaFormer in Pytorch ++ Zeta from the paper: "Can Mamba Learn How to Learn? A Comparative Study on In-Context Learnin…☆23Updated this week
- Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆58Oct 27, 2025Updated last year
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆979Nov 16, 2025Updated 11 months ago
- A simple and efficient Mamba implementation in pure PyTorch and MLX.☆1,484May 3, 2026Updated 6 months ago
- [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models☆244Oct 14, 2025Updated last year
- Awesome Papers related to Mamba.☆1,402Oct 17, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Reading list for research topics in state-space models☆374May 18, 2026Updated 5 months ago
- Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Ze…☆130Oct 26, 2026Updated last week
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆63Apr 8, 2024Updated 2 years ago
- LC-PLM: long-context protein language model based on BiMamba-S architecture☆25Jan 2, 2025Updated last year
- Community Implementation of the paper: "Multi-Head Mixture-of-Experts" In PyTorch☆31Oct 26, 2026Updated last week
- Conformer block with Rotary Position Embedding, modified from lucidrains' implement☆19Sep 13, 2024Updated 2 years ago
- Griffin MQA + Hawk Linear RNN Hybrid☆88Apr 13, 2026Updated 6 months ago
- Collection of papers on state-space models☆622Oct 1, 2026Updated last month
- Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficien…☆148Oct 26, 2026Updated last week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- [ICLR'25] "Understanding Bottlenecks of State Space Models through the Lens of Recency and Over-smoothing" by Peihao Wang, Ruisi Cai, Yue…☆18Mar 21, 2025Updated last year
- Some preliminary explorations of Mamba's context scaling.☆223Feb 8, 2024Updated 2 years ago
- A curated collection of papers, tutorials, videos, and other valuable resources related to Mamba.☆771Aug 5, 2026Updated 3 months ago
- Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…☆156Apr 7, 2025Updated last year
- Time Series Representation Models☆13Jul 17, 2025Updated last year
- Implementation of VisionLLaMA from the paper: "VisionLLaMA: A Unified LLaMA Interface for Vision Tasks" in PyTorch and Zeta☆15Nov 11, 2024Updated last year
- ☆216Dec 11, 2024Updated last year
- [ICML 2024] Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model☆3,914Feb 13, 2025Updated last year
- Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).☆136Oct 18, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Implementation of a modular, high-performance, and simplistic mamba for high-speed applications☆41Nov 11, 2024Updated last year
- A Triton Kernel for incorporating Bi-Directionality in Mamba2☆82Dec 18, 2024Updated last year
- ☆53Jan 28, 2025Updated last year
- Decision Mamba: Reinforcement Learning via Sequence Modeling with Selective State Spaces☆55Apr 1, 2024Updated 2 years ago
- Implementation of Adepts Fuyu all-new Multi-Modality model in pytorch☆24Nov 11, 2024Updated last year
- ☆52Jan 28, 2024Updated 2 years ago
- MultiWOZ2.1-Parser for Dialogue State Tracking☆13Aug 3, 2021Updated 5 years ago