a1k0n / a1gpt
throwaway GPT inference
☆140Updated 8 months ago
Alternatives and similar repositories for a1gpt:
Users that are interested in a1gpt are comparing it to the libraries listed below
- ☆238Updated 10 months ago
- Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).☆250Updated last year
- Richard is gaining power☆185Updated 2 months ago
- GGUF implementation in C as a library and a tools CLI program☆255Updated last month
- High-Performance FP32 Matrix Multiplication on CPU☆331Updated last month
- Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and …☆199Updated 2 months ago
- Wang Yi's GPT solution☆142Updated last year
- An implementation of bucketMul LLM inference☆215Updated 7 months ago
- Algebraic enhancements for GEMM & AI accelerators☆263Updated 2 weeks ago
- DiscoGrad - automatically differentiate across conditional branches in C++ programs☆203Updated 5 months ago
- Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)☆563Updated last year
- Mistral7B playing DOOM☆127Updated 7 months ago
- Minimal C++ implementation of GPT2☆40Updated last year
- WebGPU LLM inference tuned by hand☆148Updated last year
- ☆251Updated last year
- Inference of Mamba models in pure C☆183Updated 11 months ago
- a small code base for training large models☆284Updated last month
- C++ raytracer that supports custom models. Supports running the calculations on the CPU using C++11 threads or in the GPU via CUDA.☆75Updated 2 years ago
- Tiny inference-only implementation of LLaMA☆92Updated 10 months ago
- A BERT that you can train on a (gaming) laptop.☆210Updated last year
- A floating point arithmetic which works with types of any mantissa, exponent or base in modern header-only C++.☆81Updated 3 months ago
- Autograd to GPT-2 completely from scratch☆109Updated last week
- A really tiny autograd engine☆89Updated 10 months ago
- Revealing example of self-attention, the building block of transformer AI models☆130Updated last year
- Inference Vision Transformer (ViT) in plain C/C++ with ggml☆31Updated last year
- A pure NumPy implementation of Mamba.☆219Updated 7 months ago
- Python bindings for ggml☆136Updated 5 months ago
- This is a numpy implementation of the Skip-gram algorithm described in Mikolov et al's Word2Vec paper. It is intended for didactic purpos…☆35Updated last year
- FlashAttention (Metal Port)☆435Updated 4 months ago
- Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024☆175Updated 10 months ago