KhoomeiK / complexity-scalingLinks
gzip Predicts Data-dependent Scaling Laws
☆35Updated last year
Alternatives and similar repositories for complexity-scaling
Users that are interested in complexity-scaling are comparing it to the libraries listed below
Sorting:
- ☆27Updated 11 months ago
- ☆134Updated 2 months ago
- ☆28Updated last year
- Experiments for efforts to train a new and improved t5☆77Updated last year
- Code associated to papers on superposition (in ML interpretability)☆28Updated 2 years ago
- Sparse and discrete interpretability tool for neural networks☆63Updated last year
- ☆22Updated last year
- A MAD laboratory to improve AI architecture designs 🧪☆120Updated 6 months ago
- Triton Implementation of HyperAttention Algorithm☆48Updated last year
- ☆81Updated last year
- ☆53Updated last year
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆134Updated this week
- Proof-of-concept of global switching between numpy/jax/pytorch in a library.☆18Updated last year
- Simple repository for training small reasoning models☆33Updated 4 months ago
- ☆61Updated last year
- ☆38Updated 10 months ago
- train with kittens!☆60Updated 8 months ago
- ☆26Updated 2 years ago
- Q-Probe: A Lightweight Approach to Reward Maximization for Language Models☆41Updated last year
- ☆98Updated 5 months ago
- Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)☆23Updated 6 months ago
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆17Updated 3 months ago
- ☆78Updated 11 months ago
- Understanding how features learned by neural networks evolve throughout training☆35Updated 8 months ago
- Learning Universal Predictors☆76Updated 10 months ago
- Attribution-based Parameter Decomposition☆25Updated 2 weeks ago
- ☆21Updated 7 months ago
- Code for minimum-entropy coupling.☆32Updated 11 months ago
- ☆53Updated last year
- ☆52Updated last year