nostalgebraist / transformer-utilsView external linksLinks
Utilities for the HuggingFace transformers library
☆74Jan 21, 2023Updated 3 years ago
Alternatives and similar repositories for transformer-utils
Users that are interested in transformer-utils are comparing it to the libraries listed below
Sorting:
- Mechanistic Interpretability for Transformer Models☆53Jun 1, 2022Updated 3 years ago
- ☆21Aug 18, 2022Updated 3 years ago
- ☆284Mar 2, 2024Updated last year
- ☆24Jul 25, 2024Updated last year
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆71Jun 19, 2024Updated last year
- see github.com/understanding-search/maze-transformer☆10Dec 8, 2023Updated 2 years ago
- How to backdoor Diffie-Hellman, lessons learned from the Socat non-prime prime☆11Jun 29, 2021Updated 4 years ago
- DiCE: The Infinitely Differentiable Monte-Carlo Estimator☆32Jul 28, 2023Updated 2 years ago
- Implementation of the models and datasets used in "An Information-theoretic Approach to Distribution Shifts"☆25Nov 2, 2021Updated 4 years ago
- PyTorch-based library for various kinds of representational-similarity analysis☆24Jun 7, 2024Updated last year
- Code for the "Overcoming Sparsity Artifacts in Crosscoders to Interpret Chat-Tuning" paper.☆16Nov 21, 2025Updated 2 months ago
- DALLE-tools provided useful dataset utilities to improve you workflow with WebDatasets.☆15Mar 9, 2022Updated 3 years ago
- Code to support the guide to logical induction for software engineers☆11Mar 24, 2025Updated 10 months ago
- Universal Neurons in GPT2 Language Models☆30May 28, 2024Updated last year
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆49Jan 27, 2022Updated 4 years ago
- ☆14Mar 18, 2022Updated 3 years ago
- ☆29Apr 30, 2024Updated last year
- Experiments for the NeurIPS 2021 paper "Cockpit: A Practical Debugging Tool for the Training of Deep Neural Networks"☆13Oct 25, 2021Updated 4 years ago
- Mechanistic Interpretability Visualizations using React☆320Dec 18, 2024Updated last year
- This repo contains code to reproduce some of the results presented in the paper "SentenceMIM: A Latent Variable Language Model"☆28Jun 22, 2022Updated 3 years ago
- ModelDiff: A Framework for Comparing Learning Algorithms☆58Aug 15, 2023Updated 2 years ago
- If it quacks like a tensor...☆59Nov 13, 2024Updated last year
- A tool for benchmarking image generation models.☆33Jan 13, 2023Updated 3 years ago
- Hidden Engrams: Long Term Memory for Transformer Model Inference☆35Jun 26, 2021Updated 4 years ago
- Pytorch implementation on OpenAI's Procgen ppo-baseline, built from scratch.☆14May 17, 2024Updated last year
- Learning Safety Constraints for Large Language Models (ICML2025)☆29Aug 4, 2025Updated 6 months ago
- ☆22Updated this week
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆18Feb 17, 2023Updated 2 years ago
- Source-to-Source Debuggable Derivatives in Pure Python☆15Jan 23, 2024Updated 2 years ago
- ☆108Updated this week
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆811Updated this week
- Tools for understanding how transformer predictions are built layer-by-layer☆567Aug 7, 2025Updated 6 months ago
- TPU pod commander is a package for managing and launching jobs on Google Cloud TPU pods.☆21Sep 24, 2025Updated 4 months ago
- ☆22Aug 31, 2021Updated 4 years ago
- Pedagogical codebase for a simplified score-based generative model design, with training loop☆40Aug 28, 2021Updated 4 years ago
- ☆88Dec 18, 2025Updated last month
- A case study of efficient training of large language models using commodity hardware.☆68Aug 4, 2022Updated 3 years ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆240Dec 16, 2024Updated last year
- Code and Data for Evaluation WG☆42May 4, 2022Updated 3 years ago