brantondemoss / GrokkingComplexity
Code for
☆25Updated last month
Alternatives and similar repositories for GrokkingComplexity:
Users that are interested in GrokkingComplexity are comparing it to the libraries listed below
- Implementation of Spectral State Space Models☆16Updated 10 months ago
- Lottery Ticket Adaptation☆37Updated last month
- Collection of autoregressive model implementation☆76Updated last week
- ☆30Updated 8 months ago
- ☆53Updated last year
- A repository for research on medium sized language models.☆76Updated 7 months ago
- Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)☆16Updated last month
- The repository contains code for Adaptive Data Optimization☆21Updated last month
- ☆37Updated 5 months ago
- Evaluation of neuro-symbolic engines☆34Updated 5 months ago
- ☆69Updated 5 months ago
- Using FlexAttention to compute attention with different masking patterns☆40Updated 3 months ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆95Updated 3 weeks ago
- ☆12Updated 3 months ago
- SCREWS: A Modular Framework for Reasoning with Revisions☆27Updated last year
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- GoldFinch and other hybrid transformer components☆42Updated 5 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated 10 months ago
- LLM training in simple, raw C/CUDA☆14Updated last month
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆36Updated last year
- NanoGPT (124M) quality in 2.67B tokens☆26Updated this week
- Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"☆26Updated 4 years ago
- ☆22Updated 2 months ago
- ☆26Updated 10 months ago
- A flexible, adaptive classification system for dynamic text classification☆36Updated this week
- A general framework for inference-time scaling and steering of diffusion models with arbitrary rewards.☆40Updated this week
- ☆56Updated last week
- ☆27Updated 6 months ago
- Triton Implementation of HyperAttention Algorithm☆46Updated last year
- Jax like function transformation engine but micro, microjax☆30Updated 2 months ago