Codes for the paper The emergence of clusters in self-attention dynamics.
☆18Dec 18, 2023Updated 2 years ago
Alternatives and similar repositories for 2023-transformers
Users that are interested in 2023-transformers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Codes for the paper "A mathematical perspective on Transformers".☆40Jul 8, 2024Updated last year
- Code for experiments on transformers using Markovian data.☆22Nov 22, 2024Updated last year
- My OpenFOAM solvers and problems☆15Nov 1, 2024Updated last year
- Implementation of Variance Reduction Techniques in Julia☆12Sep 6, 2016Updated 9 years ago
- The official implementation of HybridNorm: Towards Stable and Efficient Transformer Training via Hybrid Normalization☆19Mar 7, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Official Pytorch implementation of Chromatic Graph Transformers☆10Jun 14, 2023Updated 3 years ago
- Clustered Compositional Embeddings☆13Oct 25, 2023Updated 2 years ago
- ☆10Feb 19, 2019Updated 7 years ago
- Ἀνατομή is a PyTorch library to analyze representation of neural networks☆13Jan 31, 2024Updated 2 years ago
- codes and plots for "Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs"☆11Dec 30, 2024Updated last year
- Estimators for Information Theoretic Functionals using Influence Functions☆11Apr 17, 2016Updated 10 years ago
- Implementation of Unified Embedding: Battle-Tested Feature Representations for Web-Scale ML Systems☆15Nov 11, 2023Updated 2 years ago
- ☆12Sep 16, 2024Updated last year
- ☆17Jan 5, 2018Updated 8 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Unofficial Scalable-Softmax Is Superior for Attention☆21May 30, 2025Updated last year
- Create string diagrams with LaTeX!☆14Jan 3, 2025Updated last year
- ☆12Jan 17, 2024Updated 2 years ago
- Find context neurons in Pythia models.☆13Jun 13, 2023Updated 3 years ago
- Least Squares Regression for subspace clustering☆11May 27, 2018Updated 8 years ago
- ☆12Mar 19, 2021Updated 5 years ago
- Code for Unbiased Implicit Variational Inference (UIVI)☆15Jan 18, 2019Updated 7 years ago
- Toolkit for Bayesian scaling analysis☆14Sep 8, 2022Updated 3 years ago
- A multiphase field model based on machine learning method☆49Feb 10, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ICML 2022] Learning Efficient and Robust Ordinary Differential \\ Equations via Invertible Neural Networks☆11Apr 14, 2023Updated 3 years ago
- iADMM for a low-rank representation optimization problem☆13Feb 5, 2021Updated 5 years ago
- Create directory tree with attachments from Zotero☆11Jun 19, 2021Updated 5 years ago
- Conditional Linear Dynamical Systems☆17Oct 7, 2025Updated 8 months ago
- The Compositionality article class.☆14Mar 16, 2026Updated 3 months ago
- Experiment with Neural ODE on Pytorch☆14Aug 9, 2019Updated 6 years ago
- ☆13Oct 14, 2021Updated 4 years ago
- Stochastic Deep Networks☆17Jun 6, 2019Updated 7 years ago
- ☆11Mar 30, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆13Apr 17, 2025Updated last year
- Code for verifying deep neural feature ansatz☆22May 3, 2023Updated 3 years ago
- ☆13Aug 6, 2025Updated 10 months ago
- コンピュータビジョン研究コミュニティcvpaper.challengeのサマリ。サーベイ資料や研究成果など。☆12Jan 20, 2021Updated 5 years ago
- Several common methods of matrix multiplication are implemented on CPU and Nvidia GPU using C++11 and CUDA.☆14Feb 8, 2023Updated 3 years ago
- Experiments learning the even-parity dataset with MPS (tensor trains)☆24Nov 1, 2023Updated 2 years ago
- 1.2% test error on MNIST using only least squares and numpy calls.☆22Sep 13, 2023Updated 2 years ago