gi0nyx / GPT-ScratchLinks
This repo is my attempt at a rough implementation of nanoGPT trained on a dataset of 30,000 unique Twitter usernames
☆24Updated last year
Alternatives and similar repositories for GPT-Scratch
Users that are interested in GPT-Scratch are comparing it to the libraries listed below
Sorting:
- papers.day☆92Updated last year
- Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.☆44Updated last year
- Vector search over tweets from the tweet archive using OpenAI embeddings and LanceDB☆53Updated last year
- A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.☆30Updated 2 years ago
- My name is Ozymandias, King of Kings; Look on my Works, ye Mighty, and despair!☆40Updated last year
- Stream of my favorite papers and links☆41Updated 3 months ago
- could we make an ml stack in 100,000 lines of code?☆46Updated 11 months ago
- A browser extension that demos Gemini Nano via window.ai and Cartesia TTS ⚡️☆39Updated 11 months ago
- A single notebook for fine-tuning GPT-3.5 turbo☆31Updated 10 months ago
- ☆23Updated 10 months ago
- ☆114Updated 6 months ago
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆64Updated 7 months ago
- KMD is a collection of conversational exchanges between patients and doctors on various medical topics. It aims to capture the intricaci…☆24Updated last year
- A really tiny autograd engine☆94Updated 3 weeks ago
- A simple MLX implementation for pretraining LLMs on Apple Silicon.☆80Updated last month
- Simple Transformer in Jax☆137Updated last year
- Cerule - A Tiny Mighty Vision Model☆66Updated 9 months ago
- Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.☆32Updated 3 months ago
- inference code for mixtral-8x7b-32kseqlen☆100Updated last year
- Modify Entropy Based Sampling to work with Mac Silicon via MLX☆50Updated 7 months ago
- Simple orchestration for EC2 spot containers☆19Updated 8 months ago
- look how they massacred my boy☆63Updated 8 months ago
- ☆22Updated last year
- SIMD quantization kernels☆71Updated last week
- LLM training in simple, raw C/CUDA☆18Updated last year
- Ultra low overhead NVIDIA GPU telemetry plugin for telegraf with memory temperature readings.☆62Updated 11 months ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆101Updated 3 months ago
- Lego for GRPO☆28Updated 3 weeks ago
- Extensive introductory writeup on Zig language functionalities☆10Updated 11 months ago
- alternative way to calculating self attention☆18Updated last year