Alternatives and similar repositories for MemoryMosaics

Users that are interested in MemoryMosaics are comparing it to the libraries listed below

• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆82Updated 10 months ago
• katiekang1998 / reasoning_generalization
  ☆34Updated 7 months ago
• berlino / seq_icl
  ☆53Updated last year
• RobertCsordas / moeut
  ☆85Updated last year
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆38Updated 2 months ago
• ScalingIntelligence / large_language_monkeys
  ☆102Updated 11 months ago
• gregorbachmann / Next-Token-Failures
  ☆98Updated last year
• JacobPfau / fillerTokens
  ☆72Updated last year
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆77Updated 9 months ago
• mcleish7 / gemstone-scaling-laws
  ☆28Updated 6 months ago
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆25Updated 8 months ago
• martin-marek / batch-size
  📄Small Batch Size Training for Language Models
  ☆43Updated last week
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆98Updated last year
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆127Updated 8 months ago
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆90Updated 9 months ago
• epfml / llm-baselines
  nanoGPT-like codebase for LLM training
  ☆102Updated 3 months ago
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆75Updated last year
• llm-merging / LLM-Merging
  LLM-Merging: Building LLMs Efficiently through Merging
  ☆203Updated 11 months ago
• Asap7772 / understanding-rlhf
  Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…
  ☆30Updated last year
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆41Updated 10 months ago
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆63Updated last year
• lmsdss / LayerNorm-Scaling
  Official Pytorch Implementation of "The Curse of Depth in Large Language Models" by Wenfang Sun, Xinyuan Song, Pengxiang Li, Lu Yin,Yefen…
  ☆55Updated last month
• schwartz-lab-NLP / TOVA
  Token Omission Via Attention
  ☆128Updated 10 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆129Updated 8 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆78Updated last year
• JackCai1206 / arithmetic-self-improve
  ☆34Updated 6 months ago
• apple / ml-planner
  ☆55Updated last year
• minyoungg / LTE
  ☆69Updated last year
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆78Updated last year
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆131Updated last year