Alternatives and similar repositories for mamba-chat:

Users that are interested in mamba-chat are comparing it to the libraries listed below

• microsoft / Samba
  [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling
  ☆860Updated last month
• lucidrains / self-rewarding-lm-pytorch
  Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI
  ☆1,378Updated last year
• HazyResearch / m2
  Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"
  ☆549Updated 3 months ago
• jquesnelle / yarn
  YaRN: Efficient Context Window Extension of Large Language Models
  ☆1,459Updated 11 months ago
• jzhang38 / EasyContext
  Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
  ☆712Updated 6 months ago
• XueFuzhao / OpenMoE
  A family of open-sourced Mixture-of-Experts (MoE) Large Language Models
  ☆1,499Updated last year
• ezelikman / quiet-star
  Code for Quiet-STaR
  ☆729Updated 7 months ago
• datamllab / LongLM
  [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
  ☆648Updated 10 months ago
• lucidrains / MEGABYTE-pytorch
  Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch
  ☆640Updated 3 months ago
• pratyushasharma / laser
  The Truth Is In There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction
  ☆385Updated 9 months ago
• hao-ai-lab / LookaheadDecoding
  [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
  ☆1,233Updated last month
• pbelcak / UltraFastBERT
  The repository for the code of the UltraFastBERT paper
  ☆517Updated last year
• dingo-actual / infini-transformer
  PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention…
  ☆288Updated 11 months ago
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆693Updated last year
• lucidrains / ring-attention-pytorch
  Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
  ☆510Updated 5 months ago
• arielnlee / Platypus
  Code for fine-tuning Platypus fam LLMs using LoRA
  ☆628Updated last year
• kyegomez / zeta
  Build high-performance AI models with modular building blocks
  ☆492Updated this week
• AnswerDotAI / fsdp_qlora
  Training LLMs with QLoRA + FSDP
  ☆1,466Updated 5 months ago
• google-deepmind / recurrentgemma
  Open weights language model from Google DeepMind, based on Griffin.
  ☆632Updated last month
• haoliuhl / ringattention
  Large Context Attention
  ☆697Updated 2 months ago
• HazyResearch / safari
  Convolutions for Sequence Modeling
  ☆878Updated 9 months ago
• jiaweizzhao / GaLore
  GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
  ☆1,539Updated 5 months ago
• mobiusml / hqq
  Official implementation of Half-Quadratic Quantization (HQQ)
  ☆778Updated last week
• ContextualAI / HALOs
  A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
  ☆829Updated 2 weeks ago
• uclaml / SPIN
  The official implementation of Self-Play Fine-Tuning (SPIN)
  ☆1,142Updated 11 months ago
• xfactlab / orpo
  Official repository for ORPO
  ☆446Updated 10 months ago
• jondurbin / bagel
  A bagel, with everything.
  ☆318Updated last year
• locuslab / wanda
  A simple and effective LLM pruning approach.
  ☆733Updated 8 months ago
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,771Updated this week
• yule-BUAA / MergeLM
  Codebase for Merging Language Models (ICML 2024)
  ☆811Updated 11 months ago