Alternatives and similar repositories for MultiModalMamba

Users that are interested in MultiModalMamba are comparing it to the libraries listed below

• Zyphra / BlackMamba
  Code repository for Black Mamba
  ☆261Updated 2 years ago
• kyegomez / zeta
  Build high-performance AI models with modular building blocks
  ☆576Updated this week
• ContextualAI / lens
  This is the official repository for the LENS (Large Language Models Enhanced to See) system.
  ☆356Updated 6 months ago
• SkalskiP / awesome-foundation-and-multimodal-models
  👁️ + 💬 + 🎧 = 🤖 Curated list of top foundation and multimodal models! [Paper + Code + Examples + Tutorials]
  ☆637Updated last year
• mistralai-sf24 / hackathon
  ☆445Updated last year
• HyperGAI / HPT
  HPT - Open Multimodal LLMs from HyperGAI
  ☆315Updated last year
• sumo43 / loopvlm
  run paligemma in real time
  ☆133Updated last year
• LLaVA-VL / LLaVA-Plus-Codebase
  LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
  ☆763Updated 2 years ago
• gaasher / I-JEPA
  Implementation of I-JEPA from "Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture"
  ☆283Updated last year
• SkunkworksAI / BakLLaVA
  ☆716Updated last year
• apple / ml-veclip
  The official repo for the paper "VeCLIP: Improving CLIP Training via Visual-enriched Captions"
  ☆250Updated last year
• penghao-wu / vstar
  PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"
  ☆688Updated 2 years ago
• microsoft / Samba
  [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling
  ☆944Updated 2 months ago
• redotvideo / mamba-chat
  Mamba-Chat: A chat LLM based on the state-space model architecture 🐍
  ☆939Updated last year
• NousResearch / Obsidian
  Maybe the new state of the art vision model? we'll see 🤷‍♂️
  ☆171Updated 2 years ago
• sshh12 / multi_token
  Embed arbitrary modalities (images, audio, documents, etc) into large language models.
  ☆189Updated last year
• dingo-actual / infini-transformer
  PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention…
  ☆294Updated last year
• HazyResearch / m2
  Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"
  ☆562Updated last year
• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆206Updated 3 weeks ago
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆213Updated last week
• groundlight / r1_vlm
  Build your own visual reasoning model
  ☆418Updated 3 weeks ago
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆254Updated last year
• bfshi / TOAST
  Official code for "TOAST: Transfer Learning via Attention Steering"
  ☆188Updated 2 years ago
• LLaVA-VL / LLaVA-Interactive-Demo
  LLaVA-Interactive-Demo
  ☆380Updated last year
• catid / dora
  Implementation of DoRA
  ☆306Updated last year
• adithya-s-k / YoloGemma
  Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…
  ☆85Updated last year
• camenduru / LLaVA-colab
  ☆228Updated 2 years ago
• SkalskiP / SoM
  Unofficial implementation and experiments related to Set-of-Mark (SoM) 👁️
  ☆88Updated 2 years ago
• XuezheMax / megalodon
  Reference implementation of Megalodon 7B model
  ☆529Updated 8 months ago
• ai8hyf / OpenResearchAssistant
  An automated tool for discovering insights from research papaer corpora
  ☆137Updated last year