Jaykef / Triton-nanoGPT
☆13Updated 3 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for Triton-nanoGPT
- ☆50Updated 5 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆84Updated 2 weeks ago
- An implementation of the Llama architecture, to instruct and delight☆21Updated 2 months ago
- ☆72Updated 4 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆95Updated 6 months ago
- ☆53Updated 9 months ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 5 months ago
- ☆20Updated last year
- ☆39Updated 9 months ago
- ☆45Updated 9 months ago
- ☆18Updated last month
- Minimal but scalable implementation of large language models in JAX☆25Updated last week
- Experiments for efforts to train a new and improved t5☆76Updated 6 months ago
- ☆46Updated last month
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆36Updated 11 months ago
- ☆29Updated 2 months ago
- Learn CUDA with PyTorch☆14Updated last week
- ☆49Updated 7 months ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆112Updated 6 months ago
- [ICML 24 NGSM workshop] Associative Recurrent Memory Transformer implementation and scripts for training and evaluating☆31Updated this week
- Simple and efficient pytorch-native transformer training and inference (batched)☆61Updated 7 months ago
- Parallel Associative Scan for Language Models☆18Updated 10 months ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆78Updated 9 months ago
- Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…☆49Updated last year
- ☆50Updated last month
- A fusion of a linear layer and a cross entropy loss, written for pytorch in triton.☆54Updated 3 months ago
- GoldFinch and other hybrid transformer components☆39Updated 3 months ago
- ☆61Updated 2 months ago
- ☆13Updated 4 months ago