Alternatives and similar repositories for mamba:

Users that are interested in mamba are comparing it to the libraries listed below

• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated 8 months ago
• catid / lllm
  Latent Large Language Models
  ☆17Updated 5 months ago
• LegallyCoder / mamba-hf
  Implementation of the Mamba SSM with hf_integration.
  ☆56Updated 5 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆43Updated 6 months ago
• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆27Updated this week
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆96Updated 4 months ago
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆19Updated last month
• kyegomez / Kosmos-X
  The Next Generation Multi-Modality Superintelligence
  ☆70Updated 4 months ago
• lucidrains / mirasol-pytorch
  Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch
  ☆88Updated last year
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated 10 months ago
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆38Updated 8 months ago
• Oxen-AI / mamba-dive
  This is the code that went into our practical dive using mamba as information extraction
  ☆51Updated last year
• Hannibal046 / RWKV-howto
  possibly useful materials for learning RWKV language model.
  ☆24Updated last year
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆50Updated 9 months ago
• arcee-ai / DAM
  ☆48Updated 2 months ago
• iantbutler01 / ditty
  A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.
  ☆16Updated 3 months ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated last year
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆18Updated 2 weeks ago
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated 8 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆34Updated 9 months ago
• wdlctc / mini-s
  ☆43Updated 3 months ago
• codekansas / rwkv
  RWKV model implementation
  ☆37Updated last year
• CERC-AAI / Robin
  ☆62Updated 4 months ago
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆109Updated 3 months ago
• kyegomez / TinyGPTV
  Simple Implementation of TinyGPTV in super simple Zeta lego blocks
  ☆15Updated 2 months ago
• Watchfulio / dataset-generator
  A new way to generate large quantities of high quality synthetic data (on par with GPT-4), with better controllability, at a fraction of …
  ☆21Updated 3 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆29Updated 4 months ago
• kyegomez / Paper-Implementation-Template
  A simple reproducible template to implement AI research papers
  ☆22Updated 4 months ago
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆149Updated last month