Alternatives and similar repositories for mamba-chat:

Users that are interested in mamba-chat are comparing it to the libraries listed below

• microsoft / Samba
  Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"
  ☆833Updated last week
• jquesnelle / yarn
  YaRN: Efficient Context Window Extension of Large Language Models
  ☆1,405Updated 9 months ago
• XueFuzhao / OpenMoE
  A family of open-sourced Mixture-of-Experts (MoE) Large Language Models
  ☆1,427Updated 10 months ago
• jiaweizzhao / GaLore
  GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
  ☆1,486Updated 3 months ago
• google-deepmind / recurrentgemma
  Open weights language model from Google DeepMind, based on Griffin.
  ☆614Updated 6 months ago
• lucidrains / self-rewarding-lm-pytorch
  Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI
  ☆1,359Updated 9 months ago
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,400Updated this week
• hao-ai-lab / LookaheadDecoding
  [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
  ☆1,183Updated 3 months ago
• Cornell-RelaxML / quip-sharp
  ☆517Updated 3 months ago
• datamllab / LongLM
  [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
  ☆637Updated 7 months ago
• HazyResearch / m2
  Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"
  ☆545Updated last month
• ezelikman / quiet-star
  Code for Quiet-STaR
  ☆706Updated 5 months ago
• persimmon-ai-labs / adept-inference
  Inference code for Persimmon-8B
  ☆416Updated last year
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆687Updated 9 months ago
• lucidrains / MEGABYTE-pytorch
  Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch
  ☆634Updated last month
• arielnlee / Platypus
  Code for fine-tuning Platypus fam LLMs using LoRA
  ☆626Updated 11 months ago
• syncdoth / RetNet
  Huggingface compatible implementation of RetNet (Retentive Networks, https://arxiv.org/pdf/2307.08621.pdf) including parallel, recurrent,…
  ☆225Updated 10 months ago
• apoorvumang / prompt-lookup-decoding
  ☆497Updated 5 months ago
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆1,022Updated this week
• HazyResearch / safari
  Convolutions for Sequence Modeling
  ☆876Updated 7 months ago
• SkunkworksAI / hydra-moe
  ☆412Updated last year
• myshell-ai / JetMoE
  Reaching LLaMA2 Performance with 0.1M Dollars
  ☆967Updated 6 months ago
• Leeroo-AI / mergoo
  A library for easily merging multiple LLM experts, and efficiently train the merged LLM.
  ☆431Updated 5 months ago
• pbelcak / UltraFastBERT
  The repository for the code of the UltraFastBERT paper
  ☆514Updated 10 months ago
• mobiusml / hqq
  Official implementation of Half-Quadratic Quantization (HQQ)
  ☆737Updated 2 weeks ago
• pratyushasharma / laser
  The Truth Is In There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction
  ☆378Updated 6 months ago
• stanfordnlp / pyreft
  ReFT: Representation Finetuning for Language Models
  ☆1,388Updated 3 weeks ago
• princeton-nlp / MeZO
  [NeurIPS 2023] MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333
  ☆1,076Updated last year
• johnma2006 / mamba-minimal
  Simple, minimal implementation of the Mamba SSM in one file of PyTorch.
  ☆2,700Updated 10 months ago
• jzhang38 / EasyContext
  Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
  ☆694Updated 4 months ago