Superposition Yields Robust Neural Scaling
☆71May 31, 2026Updated 2 months ago
Alternatives and similar repositories for SuperpositionScaling
Users that are interested in SuperpositionScaling are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- When Reasoning Meets Its Laws☆38Jan 2, 2026Updated 7 months ago
- We study toy models of skill learning.☆35Feb 3, 2026Updated 6 months ago
- Fork of Flame repo for training of some new stuff in development☆20Jul 31, 2026Updated last week
- Code repository for the ICML 2026 Oral paper "Characterizing, Evaluating, and Optimizing Complex Reasoning".☆17Jun 21, 2026Updated last month
- Universal Neurons in GPT2 Language Models☆30May 28, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Official PyTorch implementation of "Evolving Search Space for Neural Architecture Search"☆12Aug 18, 2021Updated 4 years ago
- Code for RepNAS☆14Dec 21, 2021Updated 4 years ago
- ☆21Mar 3, 2026Updated 5 months ago
- Experimental version of jxbz/agd implementing support for bias terms, affine parameters, transformers, etc.☆12Jul 30, 2023Updated 3 years ago
- Code and data for the paper "LatentLens: Revealing Highly Interpretable Visual Tokens in LLMs"☆48Mar 31, 2026Updated 4 months ago
- ☆15Nov 17, 2020Updated 5 years ago
- Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"☆92Sep 12, 2025Updated 10 months ago
- Pure C wrapper library to use llama.cpp with Linux and Windows as simple as possible.☆15Jul 28, 2026Updated last week
- Experimental interface environment for open source LLM, designed to democratize the use of AI. Powered by llama-cpp, llama-cpp-python and…☆19Oct 11, 2025Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- (ICML 2023) Feature learning in deep classifiers through Intermediate Neural Collapse: Accompanying code☆16Jul 27, 2023Updated 3 years ago
- ☆13Feb 17, 2025Updated last year
- Implementation of PGONAS for CVPR22W and RD-NAS for ICASSP23☆23Apr 25, 2023Updated 3 years ago
- The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…☆20Sep 18, 2023Updated 2 years ago
- Port of Facebook's LLaMA model in C/C++☆13Mar 19, 2023Updated 3 years ago
- An Algorithmic Information Theory Library (And Information-theory broadly); Implements numerous approximations, estimations, as well as a…☆18Jun 30, 2026Updated last month
- [NeurIPS 2021] “Stronger NAS with Weaker Predictors“, Junru Wu, Xiyang Dai, Dongdong Chen, Yinpeng Chen, Mengchen Liu, Ye Yu, Zhangyang W…☆27Sep 23, 2022Updated 3 years ago
- [NeurIPS 2024 Spotlight] code for "Diffusion Model with Cross Attention as an Inductive Bias for Disentanglement"☆20Jan 26, 2025Updated last year
- This is a fork of SGLang for hip-attention integration. Please refer to hip-attention for detail.☆18Mar 31, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆23Nov 26, 2024Updated last year
- Mic-controlled mouse clicks☆17Oct 6, 2025Updated 10 months ago
- [Preprint] GMem: A Modular Approach for Ultra-Efficient Generative Models☆43Mar 11, 2025Updated last year
- A very hacky set of functions for getting plotly to do what I want when doing mech interp research, designed to be compatible with PyTorc…☆15Jun 16, 2023Updated 3 years ago
- [EMNLP 2022] Code and data for "Controllable Dialogue Simulation with In-Context Learning"☆34Feb 22, 2023Updated 3 years ago
- [ICLR 2021] CompOFA: Compound Once-For-All Networks For Faster Multi-Platform Deployment☆25Jan 5, 2023Updated 3 years ago
- Generate Duolingo-style quiz courses from PDFs with spaced repetition, adaptive difficulty, and tutor chat.☆16Apr 6, 2026Updated 4 months ago
- ☆32Nov 4, 2024Updated last year
- Repository for the paper "Advancing General-Purpose Reasoning Models with Modular Gradient Surgery"☆22Mar 15, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆16Jun 15, 2026Updated last month
- SCOPE ICLR 2025☆23Oct 3, 2025Updated 10 months ago
- ☆17Aug 2, 2023Updated 3 years ago
- Milk-V Duo. Access to Internet throw USB RNDIS connection to host machine☆16Jan 11, 2024Updated 2 years ago
- [ICML 2026] Code for Equilibrium Reasoners: learning attractor dynamics for scalable reasoning☆45Updated this week
- Code for experiments on self-prediction as a way to measure introspection in LLMs☆16Dec 10, 2024Updated last year
- Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).☆27Aug 25, 2024Updated last year