yk / llmvm
☆29Updated last year
Related projects ⓘ
Alternatives and complementary repositories for llmvm
- ☆53Updated 10 months ago
- ☆36Updated 3 months ago
- Latent Diffusion Language Models☆67Updated last year
- Simplex Random Feature attention, in PyTorch☆71Updated last year
- ☆57Updated 11 months ago
- Learning Universal Predictors☆69Updated 3 months ago
- Code for minimum-entropy coupling.☆30Updated 4 months ago
- Jax like function transformation engine but micro, microjax☆26Updated 3 weeks ago
- ☆31Updated 2 months ago
- Generative cellular automaton-like learning environments for RL.☆19Updated last month
- ☆49Updated 8 months ago
- ☆22Updated last year
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated last year
- Muon optimizer for neural networks: >30% extra sample efficiency, <3% wallclock overhead☆113Updated this week
- Collection of autoregressive model implementation☆67Updated this week
- [WIP] Transformer to embed Danbooru labelsets☆13Updated 7 months ago
- Triton Implementation of HyperAttention Algorithm☆46Updated 11 months ago
- ☆27Updated 4 months ago
- gzip Predicts Data-dependent Scaling Laws☆32Updated 5 months ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆29Updated 2 weeks ago
- A place to store reusable transformer components of my own creation or found on the interwebs☆44Updated 2 weeks ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated last year
- look how they massacred my boy☆58Updated last month
- ☆39Updated 10 months ago
- ☆58Updated 2 years ago
- ☆62Updated last month
- GoldFinch and other hybrid transformer components☆39Updated 4 months ago
- Genetics for Language Models☆12Updated 4 months ago
- RWKV model implementation☆38Updated last year
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆85Updated 2 months ago