Alternatives and similar repositories for MultiModalMamba

Users that are interested in MultiModalMamba are comparing it to the libraries listed below

• Zyphra / BlackMamba
  Code repository for Black Mamba
  ☆258Updated last year
• kyegomez / zeta
  Build high-performance AI models with modular building blocks
  ☆559Updated this week
• SkunkworksAI / BakLLaVA
  ☆714Updated last year
• SkalskiP / awesome-foundation-and-multimodal-models
  👁️ + 💬 + 🎧 = 🤖 Curated list of top foundation and multimodal models! [Paper + Code + Examples + Tutorials]
  ☆636Updated last year
• dingo-actual / infini-transformer
  PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention…
  ☆292Updated last year
• microsoft / Samba
  [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling
  ☆917Updated 6 months ago
• HazyResearch / m2
  Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"
  ☆560Updated 10 months ago
• HyperGAI / HPT
  HPT - Open Multimodal LLMs from HyperGAI
  ☆315Updated last year
• catid / dora
  Implementation of DoRA
  ☆304Updated last year
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆246Updated last year
• sumo43 / loopvlm
  run paligemma in real time
  ☆133Updated last year
• LLaVA-VL / LLaVA-Plus-Codebase
  LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
  ☆758Updated last year
• ContextualAI / lens
  This is the official repository for the LENS (Large Language Models Enhanced to See) system.
  ☆354Updated 3 months ago
• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆192Updated this week
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆207Updated last week
• NousResearch / Obsidian
  Maybe the new state of the art vision model? we'll see 🤷‍♂️
  ☆165Updated last year
• apple / ml-veclip
  The official repo for the paper "VeCLIP: Improving CLIP Training via Visual-enriched Captions"
  ☆246Updated 9 months ago
• mistralai-sf24 / hackathon
  ☆446Updated last year
• merveenoyan / siglip
  Projects based on SigLIP (Zhai et. al, 2023) and Hugging Face transformers integration 🤗
  ☆280Updated 8 months ago
• penghao-wu / vstar
  PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"
  ☆681Updated last year
• gaasher / I-JEPA
  Implementation of I-JEPA from "Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture"
  ☆274Updated 9 months ago
• apple / ml-aim
  This repository provides the code and model checkpoints for AIMv1 and AIMv2 research projects.
  ☆1,378Updated 2 months ago
• camenduru / LLaVA-colab
  ☆227Updated last year
• sshh12 / multi_token
  Embed arbitrary modalities (images, audio, documents, etc) into large language models.
  ☆186Updated last year
• LLaVA-VL / LLaVA-Interactive-Demo
  LLaVA-Interactive-Demo
  ☆379Updated last year
• kyegomez / Python-Package-Template
  A easy, reliable, fluid template for python packages complete with docs, testing suites, readme's, github workflows, linting and much muc…
  ☆187Updated last week
• adithya-s-k / YoloGemma
  Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…
  ☆84Updated last year
• bfshi / TOAST
  Official code for "TOAST: Transfer Learning via Attention Steering"
  ☆186Updated 2 years ago
• SHI-Labs / VCoder
  [CVPR 2024] VCoder: Versatile Vision Encoders for Multimodal Large Language Models
  ☆277Updated last year
• redotvideo / mamba-chat
  Mamba-Chat: A chat LLM based on the state-space model architecture 🐍
  ☆933Updated last year