A code repository accompanying the paper "Transformers, parallel computation, and logarithmic depth" by Clayton Sanford, Daniel Hsu, and Matus Telgarsky.
☆12Feb 15, 2024Updated 2 years ago
Alternatives and similar repositories for hop-induction-heads
Users that are interested in hop-induction-heads are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR 2025] This repository contains the code to reproduce the results from our paper From Sparse Dependence to Sparse Attention: Unveili…☆12Mar 7, 2025Updated last year
- Codebase for the paper "A Percolation Model of Emergence: Analyzing Transformers Trained on a Formal Language"☆11Oct 11, 2024Updated 2 years ago
- Working Group on Becoming Full-Stack AI Researchers (Fall 2025 - Fall 2026)☆11May 12, 2026Updated 6 months ago
- ☆15Sep 29, 2022Updated 4 years ago
- Code for Looped Transformers for Length Generalization (https://arxiv.org/abs/2409.15647), ICLR 2025☆15Apr 30, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Official code for the paper Scale leads to compositional generalization.☆13Jul 11, 2025Updated last year
- Official Repository of Paper "Watch the Weights: Unsupervised monitoring and control of fine-tuned LLMs"☆15Sep 25, 2025Updated last year
- Slides from my talks☆13Sep 27, 2026Updated last month
- ☆12Apr 19, 2024Updated 2 years ago
- ☆35Jul 5, 2023Updated 3 years ago
- Reproducing GPT on the TinyStories dataset☆22Jan 18, 2024Updated 2 years ago
- ☆11Mar 5, 2021Updated 5 years ago
- The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size☆19May 19, 2019Updated 7 years ago
- 2016 Presidential Campaign Speeches☆15Oct 25, 2016Updated 10 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 6,080-param transformer achieving 100% accuracy on 10-digit addition. Trained from scratch in 10 minutes.☆22Feb 19, 2026Updated 9 months ago
- yfinance-cpp is a C++ implementation of the popular Python library yfinance, designed to provide easy access to historical market data, s…☆13Dec 4, 2023Updated 2 years ago
- Visualization of mean field and neural tangent kernel regime☆23Jul 25, 2024Updated 2 years ago
- A tool for web browsers that simulates execution of the dynamic GoI abstract machine for the lambda-calculus.☆15Oct 1, 2021Updated 5 years ago
- Fundamental Benefit of Alternating Uptades in Minimax Optimization (ICML 2024)☆10Jan 14, 2025Updated last year
- Math tutor based on question asking☆13Jan 26, 2023Updated 3 years ago
- ☆88Aug 31, 2023Updated 3 years ago
- Get a notification if a website is known to publish fake news☆14Feb 6, 2020Updated 6 years ago
- ☆29Feb 20, 2026Updated 9 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Code for "What really matters in matrix-whitening optimizers?"☆25Oct 31, 2025Updated last year
- Code for "Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining"☆30Oct 14, 2025Updated last year
- Design and analyze optimal deep learning models.☆32Aug 2, 2025Updated last year
- ☆10Jul 27, 2026Updated 3 months ago
- Reads ImageJ ROI files into numpy arrays.☆14Feb 21, 2019Updated 7 years ago
- A web app to view the location of all Guelph Transit buses☆17Nov 13, 2026Updated last week
- Official Code for What Makes and Breaks Safety Fine-tuning? A Mechanistic Study (NeurIPS 2024)☆11Oct 31, 2024Updated 2 years ago
- ☆14Dec 13, 2024Updated last year
- ☆10Oct 3, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆11Jan 15, 2026Updated 10 months ago
- ☆13Jan 2, 2026Updated 10 months ago
- Flax (JAX) implementation of Progressive Growing of GANs for Improved Quality, Stability, and Variation☆12May 24, 2021Updated 5 years ago
- The code for creating the iGSM datasets in papers "Physics of Language Models Part 2.1, Grade-School Math and the Hidden Reasoning Proces…☆92Jan 12, 2025Updated last year
- A framework to meta-train transformers for causal ICL☆11Jul 15, 2026Updated 4 months ago
- Experimental Matlab implementation of the Higher-Order Generalized Singular Value (HO-GSVD) Decomposition☆11Mar 17, 2023Updated 3 years ago
- ☆12Nov 29, 2021Updated 4 years ago
Are these results useful?