Decoder only transformer, built from scratch with PyTorch
☆33Oct 22, 2023Updated 2 years ago
Alternatives and similar repositories for transformer-from-scratch
Users that are interested in transformer-from-scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆37Apr 30, 2024Updated 2 years ago
- A python sdk for LLM finetuning and inference on runpod infrastructure☆27Apr 23, 2026Updated last week
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆30May 23, 2024Updated last year
- A benchmark for mechanistic discovery of circuits in Transformers☆16Dec 15, 2024Updated last year
- A library for mechanistic anomaly detection☆22Jan 9, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Sparse Autoencoder for Mechanistic Interpretability☆295Jul 20, 2024Updated last year
- Mechanistic Interpretability Visualizations using React☆341Dec 18, 2024Updated last year
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆254Feb 27, 2026Updated 2 months ago
- ☆161Dec 30, 2025Updated 3 months ago
- A blog on AI, personal development, and living a good life.☆40Updated this week
- Experiments with representation engineering☆14Feb 28, 2024Updated 2 years ago
- Trains small LMs. Designed for training on SimpleStories☆13Sep 15, 2025Updated 7 months ago
- Sparse and discrete interpretability tool for neural networks☆64Feb 12, 2024Updated 2 years ago
- Minimum Description Length probing for neural network representations☆20Jan 28, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Fluent dreaming for language models☆13Jul 22, 2024Updated last year
- A library for efficient patching and automatic circuit discovery.☆96Dec 31, 2025Updated 3 months ago
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆183Apr 13, 2026Updated 2 weeks ago
- Code for our paper "Localizing Lying in Llama"☆14Apr 24, 2025Updated last year
- ☆411Aug 21, 2025Updated 8 months ago
- einsum via batch matrix multiply☆15Nov 29, 2023Updated 2 years ago
- Efficiently computing & storing token n-grams from large corpora☆27Oct 6, 2024Updated last year
- volumetric brush implementation, heavily inspired by toxiclibs☆14Dec 10, 2022Updated 3 years ago
- Situational Awareness Dataset☆49Dec 14, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆16Apr 15, 2024Updated 2 years ago
- (Model-written) LLM evals library☆18Dec 13, 2024Updated last year
- ☆11Mar 24, 2025Updated last year
- Code for our paper "Decomposing The Dark Matter of Sparse Autoencoders"☆23Feb 6, 2025Updated last year
- ☆24Dec 11, 2024Updated last year
- Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…☆13Jan 26, 2025Updated last year
- Distribution Preserving Backdoor Attack in Self-supervised Learning☆20Jan 27, 2024Updated 2 years ago
- Official Code for our paper: "Language Models Learn to Mislead Humans via RLHF""☆19Oct 11, 2024Updated last year
- Attribution-based Parameter Decomposition☆34Jun 11, 2025Updated 10 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- My Emacs configuration.☆12Mar 20, 2026Updated last month
- ☆280Oct 1, 2024Updated last year
- This repo is built to facilitate the training and analysis of autoregressive transformers on maze-solving tasks.☆35Oct 28, 2025Updated 6 months ago
- A simple algorithm that finds a simultaneous block diagonalization of multiple matrices through the eigendecomposition of a single matrix…☆16Feb 24, 2026Updated 2 months ago
- Tools for understanding how transformer predictions are built layer-by-layer☆585Aug 7, 2025Updated 8 months ago
- Training Sparse Autoencoders on Language Models☆1,335Apr 22, 2026Updated last week
- This is the code for the paper Jacobian-based Causal Discovery with Nonlinear ICA, demonstrating how identifiable representations (partic…☆22Sep 5, 2024Updated last year