a1k0n / a1gptLinks
throwaway GPT inference
☆140Updated last year
Alternatives and similar repositories for a1gpt
Users that are interested in a1gpt are comparing it to the libraries listed below
Sorting:
- ☆248Updated last year
- Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).☆252Updated last year
- Richard is gaining power☆189Updated this week
- Wang Yi's GPT solution☆141Updated last year
- Pytorch script hot swap: Change code without unloading your LLM from VRAM☆126Updated 2 months ago
- Multi-Threaded FP32 Matrix Multiplication on x86 CPUs☆352Updated 2 months ago
- Algebraic enhancements for GEMM & AI accelerators☆277Updated 3 months ago
- ☆163Updated last year
- An implementation of bucketMul LLM inference☆217Updated 11 months ago
- Tensor library & inference framework for machine learning☆77Updated last week
- Tiny Dream - An embedded, Header Only, Stable Diffusion C++ implementation☆262Updated last year
- ☆253Updated last year
- GGUF implementation in C as a library and a tools CLI program☆273Updated 5 months ago
- A BERT that you can train on a (gaming) laptop.☆209Updated last year
- Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)☆567Updated last year
- Code sample showing how to run and benchmark models on Qualcomm's Window PCs☆99Updated 8 months ago
- WebGPU LLM inference tuned by hand☆151Updated 2 years ago
- Inference of Mamba models in pure C☆187Updated last year
- ☆196Updated last month
- GPU-targeted vendor-agnostic AI library for Windows, and Mistral model implementation.☆58Updated last year
- A really tiny autograd engine☆94Updated 3 weeks ago
- A fork of llama3.c used to do some R&D on inferencing☆22Updated 6 months ago
- ☆296Updated last year
- Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and …☆206Updated 7 months ago
- A floating point arithmetic which works with types of any mantissa, exponent or base in modern header-only C++.☆81Updated 8 months ago
- a small code base for training large models☆301Updated last month
- A thin, highly portable toolkit for efficiently compiling dense loop-based computation.☆148Updated 2 years ago
- Autograd to GPT-2 completely from scratch☆113Updated 2 months ago
- Heirarchical Navigable Small Worlds☆97Updated 2 months ago
- Revealing example of self-attention, the building block of transformer AI models☆131Updated 2 years ago