okarthikb / state-space-models
☆27Updated 7 months ago
Alternatives and similar repositories for state-space-models:
Users that are interested in state-space-models are comparing it to the libraries listed below
- Jax like function transformation engine but micro, microjax☆30Updated 3 months ago
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆17Updated last week
- ☆53Updated last year
- ☆37Updated 6 months ago
- look how they massacred my boy☆63Updated 4 months ago
- gzip Predicts Data-dependent Scaling Laws☆34Updated 8 months ago
- NanoGPT (124M) quality in 2.67B tokens☆27Updated this week
- ☆60Updated last year
- Collection of autoregressive model implementation☆81Updated this week
- ☆22Updated last year
- train entropix like a champ!☆20Updated 4 months ago
- ☆49Updated 11 months ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆30Updated 2 months ago
- supporting pytorch FSDP for optimizers☆76Updated 2 months ago
- Your favourite classical machine learning algos on the GPU/TPU☆20Updated last month
- ☆20Updated 9 months ago
- Latent Large Language Models☆17Updated 5 months ago
- ☆19Updated 4 months ago
- Triton Implementation of HyperAttention Algorithm☆46Updated last year
- ☆42Updated last year
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆36Updated last year
- ☆78Updated 10 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆102Updated 2 months ago
- LLM training in simple, raw C/CUDA☆14Updated 2 months ago
- GoldFinch and other hybrid transformer components☆43Updated 7 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆95Updated 3 months ago
- train with kittens!☆53Updated 3 months ago