bclarkson-code / TricycleLinks
Autograd to GPT-2 completely from scratch
☆113Updated 2 months ago
Alternatives and similar repositories for Tricycle
Users that are interested in Tricycle are comparing it to the libraries listed below
Sorting:
- Pytorch script hot swap: Change code without unloading your LLM from VRAM☆126Updated 2 months ago
- Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).☆252Updated last year
- ☆248Updated last year
- Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and …☆206Updated 7 months ago
- Simple Transformer in Jax☆137Updated last year
- in this repository, i'm going to implement increasingly complex llm inference optimizations☆60Updated last month
- A pure NumPy implementation of Mamba.☆223Updated 11 months ago
- A really tiny autograd engine☆94Updated 3 weeks ago
- ☆340Updated this week
- An implementation of bucketMul LLM inference☆217Updated 11 months ago
- Mistral7B playing DOOM☆132Updated 11 months ago
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆285Updated 3 weeks ago
- Teaching transformers to play chess☆126Updated 4 months ago
- look how they massacred my boy☆63Updated 8 months ago
- rl from zero pretrain, can it be done? we'll see.☆56Updated this week
- PageRank for LLMs☆42Updated 2 months ago
- A playground to make it easy to try crazy things☆33Updated last week
- Lightweight Llama 3 8B Inference Engine in CUDA C☆47Updated 3 months ago
- a curated list of data for reasoning ai☆136Updated 10 months ago
- Official codebase for the paper "Beyond A* Better Planning with Transformers via Search Dynamics Bootstrapping".☆368Updated last year
- Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish☆173Updated 10 months ago
- Some experiments on transformer models☆11Updated last year
- R.L. methods and techniques.☆190Updated 7 months ago
- PyTorch implementation of models from the Zamba2 series.☆182Updated 5 months ago
- A simple MLX implementation for pretraining LLMs on Apple Silicon.☆80Updated last month
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- Pivotal Token Search☆104Updated last month
- ☆116Updated 4 months ago
- SIMD quantization kernels☆71Updated last week
- NanoGPT-speedrunning for the poor T4 enjoyers☆66Updated 2 months ago