LIONS-EPFL/scion external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

LIONS-EPFL/scion

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/LIONS-EPFL/scion)

Close

LIONS-EPFL / scionView on GitHubMore

• External links
• Readme badge

☆55Feb 24, 2026Updated last week

Alternatives and similar repositories for scion

Users that are interested in scion are comparing it to the libraries listed below

• nikhilvyas / SOAP_MUON

  View on GitHub
  Combining SOAP and MUON
  ☆19Feb 11, 2025Updated last year
• allenai / signal-and-noise

  View on GitHub
  Measuring the Signal to Noise Ratio in Language Model Evaluation
  ☆28Aug 19, 2025Updated 6 months ago
• apple / ml-ademamix

  View on GitHub
  ☆70Nov 15, 2024Updated last year
• edwardmilsom / function-space-learning-rates-paper

  View on GitHub
  Code for the paper "Function-Space Learning Rates"
  ☆25Jun 3, 2025Updated 9 months ago
• Sike-Wang / low-bit-Shampoo

  View on GitHub
  4-bit Shampoo for Memory-Efficient Network Training (NeurIPS 2024)
  ☆13Feb 13, 2025Updated last year
• GATECH-EIC / LaCache

  View on GitHub
  [ICML 2025] LaCache: Ladder-Shaped KV Caching for Efficient Long-Context Modeling of Large Language Models
  ☆17Nov 4, 2025Updated 4 months ago
• leloykun / adaptive-muon

  View on GitHub
  A single-line modification to any (dualizer-based) optimizer that allows the optimizer to adapt to the scale of the gradients as they cha…
  ☆19Jan 11, 2025Updated last year
• Triang-jyed-driung / rwkv7mini

  View on GitHub
  RWKV-7 mini
  ☆12Mar 29, 2025Updated 11 months ago
• NoahAmsel / PolarExpress

  View on GitHub
  ☆24Feb 25, 2026Updated last week
• samblouir / birdie

  View on GitHub
  ☆13Dec 15, 2025Updated 2 months ago
• bentherien / mu_learned_optimization

  View on GitHub
  [Oral; Neurips OPT2024 ] μLO: Compute-Efficient Meta-Generalization of Learned Optimizers
  ☆15Feb 12, 2026Updated 3 weeks ago
• mdering / CoreMLZoo

  View on GitHub
  A few models converted from caffe to CoreMLs format.
  ☆15Jun 6, 2017Updated 8 years ago
• shawntan / stickbreaking-attention

  View on GitHub
  Stick-breaking attention
  ☆62Jul 1, 2025Updated 8 months ago
• MarlonBecker / MSAM

  View on GitHub
  ☆21Jan 23, 2024Updated 2 years ago
• nikhilvyas / SOAP

  View on GitHub
  ☆252Dec 2, 2024Updated last year
• apple / ml-dataset-decomposition

  View on GitHub
  Official repo of dataset-decomposition paper [NeurIPS 2024]
  ☆21Jan 8, 2025Updated last year
• mekty2012 / Deep-Learning-Theory

  View on GitHub
  Repository for Deep Learning Theory papers
  ☆15Jan 24, 2024Updated 2 years ago
• EleutherAI / training-jacobian

  View on GitHub
  ☆24Dec 11, 2024Updated last year
• epfml / llm-baselines

  View on GitHub
  nanoGPT-like codebase for LLM training
  ☆116Nov 7, 2025Updated 3 months ago
• epfml / schedules-and-scaling

  View on GitHub
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆92Oct 30, 2024Updated last year
• ethansmith2000 / TransformerExperiments

  View on GitHub
  ☆19Dec 4, 2025Updated 3 months ago
• google-deepmind / asyncdiloco

  View on GitHub
  ☆47Jan 18, 2024Updated 2 years ago
• vectozavr / llm-hessian

  View on GitHub
  Using PyTorch autograd to compute Hessian of Perplexity for Large Language Models
  ☆27Apr 17, 2025Updated 10 months ago
• Unakar / Spectral-Sphere-Optimizer

  View on GitHub
  Spectral Sphere Optimizer
  ☆104Jan 14, 2026Updated last month
• ML-GSAI / eMIGM

  View on GitHub
  Official PyTorch implementation for "Effective and Efficient Masked Image Generation Models"
  ☆31Apr 8, 2025Updated 10 months ago
• zichongli5 / NorMuon

  View on GitHub
  Official Implementation for NorMuon paper
  ☆57Feb 9, 2026Updated 3 weeks ago
• ULTRA-HOI / HOI4-ULTRA-Project

  View on GitHub
  Github Repository for the HOI4 ULTRA Project.
  ☆11Updated this week
• PKU-ML / LongPPL

  View on GitHub
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆110Oct 11, 2025Updated 4 months ago
• thinking-machines-lab / manifolds

  View on GitHub
  Supporting code for the blog post on modular manifolds.
  ☆117Sep 26, 2025Updated 5 months ago
• berlino / seq_icl

  View on GitHub
  ☆53May 20, 2024Updated last year
• kyleliang919 / Super_Muon

  View on GitHub
  ☆67Mar 21, 2025Updated 11 months ago
• huanranchen / LLMLandscape

  View on GitHub
  The loss landscape of Large Language Models resemble basin!
  ☆36Jul 8, 2025Updated 7 months ago
• shikaiqiu / compute-better-spent

  View on GitHub
  ☆63Oct 3, 2024Updated last year
• DS3Lab / CocktailSGD

  View on GitHub
  ☆27Aug 25, 2023Updated 2 years ago
• nil0x9 / flash-muon

  View on GitHub
  Flash-Muon: An Efficient Implementation of Muon Optimizer
  ☆237Jun 15, 2025Updated 8 months ago
• jopetty / word-problem

  View on GitHub
  Experiments on the impact of depth in transformers and SSMs.
  ☆40Oct 23, 2025Updated 4 months ago
• lucaslingle / mu_transformer

  View on GitHub
  Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.
  ☆32Jun 5, 2025Updated 8 months ago
• habanero-lab / APPy

  View on GitHub
  APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…
  ☆30Jan 28, 2026Updated last month
• HomebrewML / HeavyBall

  View on GitHub
  Efficient optimizers
  ☆285Dec 20, 2025Updated 2 months ago