okarthikb / state-space-models
☆27Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for state-space-models
- Collection of autoregressive model implementation☆67Updated this week
- Jax like function transformation engine but micro, microjax☆26Updated 3 weeks ago
- look how they massacred my boy☆58Updated last month
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆84Updated last week
- Simple Transformer in Jax☆119Updated 4 months ago
- ☆49Updated 8 months ago
- ☆36Updated 3 months ago
- LLM training in simple, raw C/CUDA☆12Updated last month
- Normalized Transformer (nGPT)☆66Updated this week
- Latent Large Language Models☆16Updated 2 months ago
- ☆53Updated 10 months ago
- Gpu benchmark☆43Updated last month
- ☆22Updated last year
- ☆57Updated 11 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆95Updated 6 months ago
- ☆101Updated 3 months ago
- ☆39Updated 10 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆104Updated last month
- Clean RL implementation using MLX☆26Updated 8 months ago
- Our solution for the arc challenge 2024☆32Updated last week
- Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊☆111Updated last week
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆113Updated 7 months ago
- Muon optimizer for neural networks: >30% extra sample efficiency, <3% wallclock overhead☆109Updated last week
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆85Updated 2 months ago
- realtime latent world model inference demo☆34Updated last week
- Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…☆49Updated 3 weeks ago
- ☆43Updated 2 months ago
- smolLM with Entropix sampler on pytorch☆139Updated 2 weeks ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆29Updated 2 weeks ago
- A State-Space Model with Rational Transfer Function Representation.☆70Updated 6 months ago