Alternatives and similar repositories for MemoryMosaics

Users that are interested in MemoryMosaics are comparing it to the libraries listed below

• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆84Updated last year
• RobertCsordas / moeut
  ☆86Updated last year
• mcleish7 / gemstone-scaling-laws
  Gemstones: A Model Suite for Multi-Faceted Scaling Laws (NeurIPS 2025)
  ☆29Updated last month
• berlino / seq_icl
  ☆53Updated last year
• katiekang1998 / reasoning_generalization
  ☆33Updated 9 months ago
• LIONS-EPFL / scion
  ☆45Updated last week
• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆30Updated last year
• gregorbachmann / Next-Token-Failures
  ☆103Updated last year
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆38Updated 4 months ago
• ScalingIntelligence / large_language_monkeys
  ☆108Updated last year
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆100Updated last year
• apple / ml-planner
  ☆56Updated last year
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆64Updated last year
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆170Updated 4 months ago
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆83Updated 11 months ago
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆110Updated 6 months ago
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆92Updated 11 months ago
• ChenWu98 / algorithmic-creativity
  [ICML 2025] Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction
  ☆72Updated 5 months ago
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆129Updated last year
• Cranial-XIX / longhorn
  Official PyTorch Implementation of the Longhorn Deep State Space Model
  ☆55Updated 10 months ago
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆132Updated 10 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆78Updated last year
• Asap7772 / understanding-rlhf
  Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…
  ☆32Updated last year
• google-deepmind / spectral_ssm
  ☆34Updated last year
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆132Updated last year
• JacobPfau / fillerTokens
  ☆74Updated last year
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆151Updated 8 months ago
• shenao-zhang / SELM
  The official implementation of Self-Exploring Language Models (SELM)
  ☆64Updated last year
• schwartz-lab-NLP / TOVA
  Token Omission Via Attention
  ☆127Updated last year
• luchris429 / DiscoPOP
  Code for Discovering Preference Optimization Algorithms with and for Large Language Models
  ☆63Updated last year