☆30Dec 2, 2024Updated last year
Alternatives and similar repositories for minSAE
Users that are interested in minSAE are comparing it to the libraries listed below
Sorting:
- Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam☆86Jul 28, 2024Updated last year
- ☆33Nov 4, 2024Updated last year
- ☆24Jun 4, 2024Updated last year
- Code for the "Overcoming Sparsity Artifacts in Crosscoders to Interpret Chat-Tuning" paper.☆16Nov 21, 2025Updated 4 months ago
- ☆23Jun 18, 2024Updated last year
- Code to reproduce key results accompanying "SAEs (usually) Transfer Between Base and Chat Models"☆13Jul 18, 2024Updated last year
- ☆48May 27, 2025Updated 9 months ago
- Modified to support crosscoder training.☆25Feb 4, 2026Updated last month
- Engine for collecting, uploading, and downloading model activations☆26Apr 2, 2025Updated 11 months ago
- Official PyTorch implementation of TokenSet.☆128Mar 21, 2025Updated last year
- Minimal (truly) muP implementation, consistent with TP4 and TP5 papers notation☆14Jan 2, 2026Updated 2 months ago
- train with kittens!☆64Oct 25, 2024Updated last year
- Descrição diário da toda minha trajetória de estudos☆15Jan 30, 2025Updated last year
- ☆92Jul 5, 2024Updated last year
- WIP☆94Aug 13, 2024Updated last year
- Implementation of PSGD optimizer in JAX☆35Dec 31, 2024Updated last year
- These papers will provide unique insightful concepts that will broaden your perspective on neural networks and deep learning☆48Sep 3, 2023Updated 2 years ago
- ☆53Jan 6, 2024Updated 2 years ago
- ☆20Apr 10, 2025Updated 11 months ago
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆19Jul 24, 2025Updated 7 months ago
- ☆34Sep 10, 2024Updated last year
- Implementation of the BatchTopK activation function for training sparse autoencoders (SAEs)☆62Jul 24, 2025Updated 7 months ago
- Maximal Update Parametrization (μP) with Flax & Optax.☆16Dec 27, 2023Updated 2 years ago
- Repository for "Training Language Models To Explain Their Own Computations"☆21Dec 22, 2025Updated 3 months ago
- Minimal implementation of scalable rectified flow transformers, based on SD3's approach☆635Jul 1, 2024Updated last year
- Read, modify and write DICOS files with python code☆13Nov 24, 2025Updated 3 months ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Apr 17, 2024Updated last year
- Final repository for the project "Unsupervised Machine Learning for the Classification of Astrophysical X-ray Sources". V. S. Pérez-Díaz,…☆10Jan 23, 2024Updated 2 years ago
- A library for training crosscoders☆16May 28, 2025Updated 9 months ago
- PyTorch-based radio-interferometric imaging reconstruction package with scalable Bayesian uncertainty quantification relying on data-driv…☆12Feb 17, 2025Updated last year
- ☆10Apr 2, 2024Updated last year
- research impl of Native Sparse Attention (2502.11089)☆63Feb 19, 2025Updated last year
- Code and materials for "Weird Generalization and Inductive Backdoors"☆37Jan 11, 2026Updated 2 months ago
- ☆70Nov 15, 2024Updated last year
- The implementation of the paper "Retrieval-Free Knowledge-Grounded Dialogue Response Generation with Adapters".☆17May 24, 2022Updated 3 years ago
- Implementation for Proximal Neural Networks.☆11Sep 17, 2021Updated 4 years ago
- Experiments Notebook of "Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism"☆15Apr 30, 2025Updated 10 months ago
- Reasoning-based Evaluation and Ranking of Translations.☆20Jul 18, 2025Updated 8 months ago
- manipulating cointegrated pairs to achieve a market-neutral strategy that outperforms indices☆12Jan 12, 2021Updated 5 years ago