Alternatives and similar repositories for memory:

Users that are interested in memory are comparing it to the libraries listed below

• HazyResearch / lolcats
  Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"
  ☆226Updated 2 months ago
• sail-sg / oat
  🌾 OAT: A research-friendly framework for LLM online alignment, including preference learning, reinforcement learning, etc.
  ☆300Updated last week
• NVlabs / hymba
  ☆173Updated 3 months ago
• allenai / OLMo-core
  PyTorch building blocks for the OLMo ecosystem
  ☆177Updated this week
• hao-ai-lab / Consistency_LLM
  [ICML 2024] CLLMs: Consistency Large Language Models
  ☆388Updated 4 months ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆195Updated 8 months ago
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆178Updated 2 months ago
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆279Updated last month
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆168Updated 2 months ago
• dingo-actual / infini-transformer
  PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention…
  ☆287Updated 10 months ago
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆210Updated last week
• KellerJordan / Muon
  Muon optimizer: +>30% sample efficiency with <3% wallclock overhead
  ☆529Updated last week
• seal-rg / recurrent-pretraining
  Pretraining code for a large-scale depth-recurrent language model
  ☆709Updated 2 weeks ago
• NVIDIA / Star-Attention
  Efficient LLM Inference over Long Sequences
  ☆365Updated last month
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆149Updated last week
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆161Updated 3 months ago
• microsoft / LongRoPE
  LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.
  ☆212Updated 7 months ago
• NVIDIA / ngpt
  Normalized Transformer (nGPT)
  ☆164Updated 4 months ago
• microsoft / rStar
  ☆493Updated last week
• zyushun / Adam-mini
  Code for Adam-mini: Use Fewer Learning Rates To Gain More https://arxiv.org/abs/2406.16793
  ☆399Updated 3 months ago
• jzhang38 / EasyContext
  Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
  ☆706Updated 6 months ago
• facebookresearch / sweet_rl
  Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks
  ☆140Updated this week
• groundlight / r1_vlm
  Build your own visual reasoning model
  ☆320Updated this week
• mit-han-lab / duo-attention
  [ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
  ☆442Updated last month
• jxiw / MambaInLlama
  [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
  ☆209Updated 3 weeks ago
• facebookresearch / swe-rl
  Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"
  ☆477Updated 2 weeks ago
• NVIDIA / NeMo-Skills
  A project to improve skills of large language models
  ☆260Updated this week
• microsoft / rho
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆405Updated 11 months ago
• huggingface / picotron_tutorial
  ☆158Updated last month
• eddycmu / demystify-long-cot
  ☆262Updated 2 weeks ago