Visualization of mean field and neural tangent kernel regime
☆23Jul 25, 2024Updated 2 years ago
Alternatives and similar repositories for NTK-and-MF-examples
Users that are interested in NTK-and-MF-examples are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆61May 11, 2021Updated 5 years ago
- codes and plots for "Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs"☆11Dec 30, 2024Updated last year
- ☆15Sep 29, 2022Updated 4 years ago
- Code for Looped Transformers for Length Generalization (https://arxiv.org/abs/2409.15647), ICLR 2025☆15Apr 30, 2025Updated last year
- Code for experiments in my blog post on the Neural Tangent Kernel: https://eigentales.com/NTK☆174Nov 10, 2019Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A quick test of SIREN on out-of-sample tasks☆13Jul 4, 2020Updated 6 years ago
- Official Repository of Paper "Watch the Weights: Unsupervised monitoring and control of fine-tuned LLMs"☆15Sep 25, 2025Updated last year
- [NeurIPS-2023] The PyTorch Implementation of MoSo. The algorithms are based on our paper: "Data Pruning via Moving-one-Sample-out". MoSo …☆11May 21, 2026Updated 5 months ago
- ☆10Dec 17, 2019Updated 6 years ago
- Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…☆211Apr 13, 2026Updated 6 months ago
- ☆67Mar 15, 2019Updated 7 years ago
- ☆20Sep 6, 2025Updated last year
- Reproducing GPT on the TinyStories dataset☆22Jan 18, 2024Updated 2 years ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆110Aug 26, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆15Sep 19, 2019Updated 7 years ago
- Public Codebase for Rethinking Parameter Counting: Effective Dimensionality Revisited☆37Dec 27, 2022Updated 3 years ago
- Code accompanying our paper "Finding trainable sparse networks through Neural Tangent Transfer" to be published at ICML-2020.☆13Jun 14, 2020Updated 6 years ago
- The official repository for paper "MLLM-Protector: Ensuring MLLM’s Safety without Hurting Performance"☆46Apr 21, 2024Updated 2 years ago
- The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size☆19May 19, 2019Updated 7 years ago
- ☆17Feb 4, 2025Updated last year
- Code for random Fourier features based on Rahimi and Recht's 2007 paper.☆61Dec 21, 2020Updated 5 years ago
- ☆29Feb 20, 2026Updated 8 months ago
- An Empirical Study of Memorization in NLP (ACL 2022)☆13Jun 22, 2022Updated 4 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Code for "Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining"☆30Oct 14, 2025Updated last year
- some common Huggingface transformers in maximal update parametrization (µP)☆88Mar 14, 2022Updated 4 years ago
- Design and analyze optimal deep learning models.☆32Aug 2, 2025Updated last year
- Computing the eigenvalues of Neural Tangent Kernel and Conjugate Kernel (aka NNGP kernel) over the boolean cube☆48Sep 19, 2019Updated 7 years ago
- Qwen3 MoE Router Statistics | 큐웬3 MoE☆11May 16, 2025Updated last year
- ☆32May 24, 2023Updated 3 years ago
- An Efficient Dataset Condensation Plugin and Its Application to Continual Learning. NeurIPS, 2023.☆12Nov 29, 2023Updated 2 years ago
- A Playground for Variational Autoencoders☆12Feb 11, 2018Updated 8 years ago
- Source code of "What can linearized neural networks actually say about generalization?☆20Oct 21, 2021Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Code used for experiments in https://arxiv.org/abs/2008.08601☆21Jun 1, 2021Updated 5 years ago
- Official Code for What Makes and Breaks Safety Fine-tuning? A Mechanistic Study (NeurIPS 2024)☆11Oct 31, 2024Updated 2 years ago
- [ECCV 2022] The official experimental code of "Sobolev Training for Implicit Neural Representations with Approximated Image Derivatives"☆32Jul 22, 2022Updated 4 years ago
- ☆16Jul 20, 2023Updated 3 years ago
- ☆27Apr 11, 2023Updated 3 years ago
- This is the official implementation for our ACL 2024 paper: "Causal Estimation of Memorisation Profiles".☆25Mar 25, 2025Updated last year
- Code for Augment & Reduce, a scalable stochastic algorithm for large categorical distributions☆10May 16, 2018Updated 8 years ago