Alternatives and similar repositories for LFM:

Users that are interested in LFM are comparing it to the libraries listed below

• Decentralised-AI / LFM-Liquid-AI-Liquid-Foundation-Models
  An open source implementation of LFMs from Liquid AI: Liquid Foundation Models
  ☆92Updated 6 months ago
• NVlabs / hymba
  ☆175Updated 4 months ago
• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆166Updated 3 weeks ago
• jxiw / MambaInLlama
  [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
  ☆214Updated last week
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆179Updated 3 months ago
• Tencent / llm.hunyuan.T1
  ☆74Updated 3 weeks ago
• NVlabs / MaskLLM
  [NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models
  ☆162Updated 3 months ago
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆54Updated last year
• HazyResearch / lolcats
  Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"
  ☆231Updated 2 months ago
• kyegomez / MoE-Mamba
  Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Ze…
  ☆102Updated 3 weeks ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆198Updated 9 months ago
• tensorgi / T6
  The official implementation of Tensor ProducT ATTenTion Transformer (T6)
  ☆361Updated last week
• OpenNLPLab / lightning-attention
  Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models
  ☆279Updated 2 months ago
• kyegomez / Mixture-of-Depths
  Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆90Updated this week
• ZihanWang314 / CoE
  Chain of Experts (CoE) enables communication between experts within Mixture-of-Experts (MoE) models
  ☆158Updated last month
• test-time-training / ttt-lm-jax
  Official JAX implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States
  ☆405Updated 8 months ago
• fxmeng / TransMLA
  TransMLA: Multi-Head Latent Attention Is All You Need
  ☆238Updated last month
• kyegomez / MambaByte
  Implementation of MambaByte in "MambaByte: Token-free Selective State Space Model" in Pytorch and Zeta
  ☆116Updated 3 weeks ago
• RyanLiu112 / compute-optimal-tts
  Official codebase for "Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scaling".
  ☆252Updated 2 months ago
• lucidrains / native-sparse-attention-pytorch
  Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper
  ☆601Updated last month
• llm-random / llm-random
  ☆185Updated last week
• lucidrains / nGPT-pytorch
  Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI
  ☆280Updated last month
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆83Updated 5 months ago
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆320Updated 4 months ago
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆158Updated 10 months ago
• microsoft / LongRoPE
  LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.
  ☆223Updated 8 months ago
• NVlabs / GatedDeltaNet
  [ICLR 2025] Official PyTorch Implementation of Gated Delta Networks: Improving Mamba2 with Delta Rule
  ☆156Updated last month
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆192Updated 3 weeks ago
• Cornell-RelaxML / qtip
  ☆130Updated last month
• NVIDIA / ngpt
  Normalized Transformer (nGPT)
  ☆171Updated 5 months ago