brantondemoss / GrokkingComplexity
Code for
☆27Updated 4 months ago
Alternatives and similar repositories for GrokkingComplexity:
Users that are interested in GrokkingComplexity are comparing it to the libraries listed below
- Evaluation of neuro-symbolic engines☆35Updated 8 months ago
- ☆31Updated 11 months ago
- Multi-Agent Verification: Scaling Test-Time Compute with Multiple Verifiers☆17Updated last month
- ☆57Updated 3 weeks ago
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆36Updated last year
- Jax like function transformation engine but micro, microjax☆30Updated 5 months ago
- ☆93Updated 2 months ago
- Triton Implementation of HyperAttention Algorithm☆47Updated last year
- ☆54Updated 7 months ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆98Updated 3 months ago
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆15Updated last week
- ☆52Updated 6 months ago
- Memory Mosaics are networks of associative memories working in concert to achieve a prediction task.☆40Updated 2 months ago
- Simple GRPO scripts and configurations.☆58Updated 2 months ago
- Implementation of OpenAI's 'Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets' paper.☆36Updated last year
- Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]☆18Updated last month
- ☆31Updated last year
- Official repo of paper LM2☆36Updated 2 months ago
- Implementation of Spectral State Space Models☆16Updated last year
- EvaByte: Efficient Byte-level Language Models at Scale☆86Updated 3 weeks ago
- ☆53Updated last year
- ☆19Updated last month
- GoldFinch and other hybrid transformer components☆45Updated 8 months ago
- Using FlexAttention to compute attention with different masking patterns☆43Updated 6 months ago
- ☆77Updated 8 months ago
- supporting pytorch FSDP for optimizers☆80Updated 4 months ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆83Updated last year
- Code accompanying the paper "A Language Model's Guide Through Latent Space". It contains functionality for training and using concept vec…☆19Updated last year
- Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"☆28Updated 4 years ago
- ☆53Updated 2 months ago