☆30Dec 2, 2024Updated last year
Alternatives and similar repositories for minSAE
Users that are interested in minSAE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam☆88Jul 28, 2024Updated last year
- ☆32Nov 4, 2024Updated last year
- ☆24Jun 4, 2024Updated 2 years ago
- Code for the "Overcoming Sparsity Artifacts in Crosscoders to Interpret Chat-Tuning" paper.☆18Nov 21, 2025Updated 7 months ago
- ☆24Jun 18, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Code to reproduce key results accompanying "SAEs (usually) Transfer Between Base and Chat Models"☆13Jul 18, 2024Updated last year
- ☆49May 27, 2025Updated last year
- Modified to support crosscoder training.☆27Feb 4, 2026Updated 4 months ago
- LLM training in simple, raw C/CUDA☆15Dec 5, 2024Updated last year
- Engine for collecting, uploading, and downloading model activations☆29Apr 2, 2025Updated last year
- Official PyTorch implementation of TokenSet.☆129Mar 21, 2025Updated last year
- Minimal (truly) muP implementation, consistent with TP4 and TP5 papers notation☆14Jan 2, 2026Updated 5 months ago
- train with kittens!☆66Oct 25, 2024Updated last year
- ☆93Jul 5, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- WIP☆96Aug 13, 2024Updated last year
- Implementation of PSGD optimizer in JAX☆36Dec 31, 2024Updated last year
- Scaling scaling laws with board games.☆53Jul 17, 2023Updated 2 years ago
- These papers will provide unique insightful concepts that will broaden your perspective on neural networks and deep learning☆48Sep 3, 2023Updated 2 years ago
- Scalable and Stable Parallelization of Nonlinear RNNS☆31Mar 6, 2026Updated 3 months ago
- ☆19Apr 10, 2025Updated last year
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆19Jul 24, 2025Updated 11 months ago
- ☆33Sep 10, 2024Updated last year
- ☆12Apr 2, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Implementation of the BatchTopK activation function for training sparse autoencoders (SAEs)☆66Jul 24, 2025Updated 11 months ago
- Repository for "Training Language Models To Explain Their Own Computations"☆22Dec 22, 2025Updated 6 months ago
- Maximal Update Parametrization (μP) with Flax & Optax.☆16Dec 27, 2023Updated 2 years ago
- Minimal implementation of scalable rectified flow transformers, based on SD3's approach☆637Jul 1, 2024Updated 2 years ago
- Read, modify and write DICOS files with python code☆13Nov 24, 2025Updated 7 months ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Apr 17, 2024Updated 2 years ago
- ☆13Mar 9, 2025Updated last year
- PyTorch-based radio-interferometric imaging reconstruction package with scalable Bayesian uncertainty quantification relying on data-driv…☆12Feb 17, 2025Updated last year
- An introduction to LLM Sampling☆80Dec 15, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- research impl of Native Sparse Attention (2502.11089)☆62Feb 19, 2025Updated last year
- A Blackjack game with GUI written in Java.☆11Nov 21, 2018Updated 7 years ago
- ☆72Nov 15, 2024Updated last year
- Experiments Notebook of "Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism"☆16Apr 30, 2025Updated last year
- Keymap for my SofleKeyboard☆10Apr 8, 2021Updated 5 years ago
- Reasoning-based Evaluation and Ranking of Translations.☆19Jun 2, 2026Updated 3 weeks ago
- manipulating cointegrated pairs to achieve a market-neutral strategy that outperforms indices☆11Jan 12, 2021Updated 5 years ago