Alternatives and similar repositories for MultiModalMamba

Users that are interested in MultiModalMamba are comparing it to the libraries listed below

• Zyphra / BlackMamba
  Code repository for Black Mamba
  ☆256Updated last year
• kyegomez / zeta
  Build high-performance AI models with modular building blocks
  ☆555Updated last week
• microsoft / Samba
  [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling
  ☆915Updated 5 months ago
• SkunkworksAI / BakLLaVA
  ☆714Updated last year
• HyperGAI / HPT
  HPT - Open Multimodal LLMs from HyperGAI
  ☆315Updated last year
• redotvideo / mamba-chat
  Mamba-Chat: A chat LLM based on the state-space model architecture 🐍
  ☆931Updated last year
• SkalskiP / awesome-foundation-and-multimodal-models
  👁️ + 💬 + 🎧 = 🤖 Curated list of top foundation and multimodal models! [Paper + Code + Examples + Tutorials]
  ☆635Updated last year
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆206Updated last month
• mistralai-sf24 / hackathon
  ☆447Updated last year
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆243Updated last year
• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆190Updated this week
• sumo43 / loopvlm
  run paligemma in real time
  ☆133Updated last year
• dingo-actual / infini-transformer
  PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention…
  ☆291Updated last year
• ContextualAI / lens
  This is the official repository for the LENS (Large Language Models Enhanced to See) system.
  ☆354Updated 2 months ago
• gaasher / I-JEPA
  Implementation of I-JEPA from "Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture"
  ☆271Updated 9 months ago
• LLaVA-VL / LLaVA-Plus-Codebase
  LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
  ☆758Updated last year
• HazyResearch / m2
  Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"
  ☆560Updated 9 months ago
• NousResearch / Obsidian
  Maybe the new state of the art vision model? we'll see 🤷‍♂️
  ☆165Updated last year
• groundlight / r1_vlm
  Build your own visual reasoning model
  ☆412Updated last month
• penghao-wu / vstar
  PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"
  ☆675Updated last year
• apple / ml-veclip
  The official repo for the paper "VeCLIP: Improving CLIP Training via Visual-enriched Captions"
  ☆245Updated 8 months ago
• catid / dora
  Implementation of DoRA
  ☆301Updated last year
• LLaVA-VL / LLaVA-Interactive-Demo
  LLaVA-Interactive-Demo
  ☆378Updated last year
• merveenoyan / siglip
  Projects based on SigLIP (Zhai et. al, 2023) and Hugging Face transformers integration 🤗
  ☆277Updated 7 months ago
• XuezheMax / megalodon
  Reference implementation of Megalodon 7B model
  ☆522Updated 4 months ago
• bfshi / TOAST
  Official code for "TOAST: Transfer Learning via Attention Steering"
  ☆186Updated 2 years ago
• sshh12 / multi_token
  Embed arbitrary modalities (images, audio, documents, etc) into large language models.
  ☆186Updated last year
• apple / ml-aim
  This repository provides the code and model checkpoints for AIMv1 and AIMv2 research projects.
  ☆1,369Updated 2 months ago
• kyegomez / Python-Package-Template
  A easy, reliable, fluid template for python packages complete with docs, testing suites, readme's, github workflows, linting and much muc…
  ☆186Updated this week
• mistralai / megablocks-public
  ☆866Updated last year