A deep-dive reference tracing every layer of the stack when you send a prompt to an LLM chat, from keystroke to streamed token. Covers tokenization, KV cache, prefill/decode, sampling, SSE streaming, and more.
☆17Apr 11, 2026Updated 3 months ago
Alternatives and similar repositories for what-happens-when-you-prompt
Users that are interested in what-happens-when-you-prompt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM terms explained from an engineering perspective with the production implications, not just the definition.☆48May 23, 2026Updated last month
- A simple but instructive implementation of DP, TP, FSDP, FSDP+TP using pytorch distributed primitives☆19Apr 12, 2026Updated 3 months ago
- A PowerShell script to fully automate the setup of `llama.cpp` on Windows. It installs all prerequisites, including the correct CUDA Tool…☆15May 12, 2026Updated 2 months ago
- ☆18Nov 5, 2024Updated last year
- ☆19Feb 13, 2026Updated 5 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Katacoda Scenarios☆23Mar 9, 2025Updated last year
- Using the Perplexica search API's "pipe" feature, taking inspiration from atgehrhardt's Live Search project.☆16Feb 13, 2025Updated last year
- Some useful decorators for any situation. Includes runtime type checking.☆25Updated this week
- A little file for doing LLM-assisted prompt expansion and image generation using Flux.schnell - complete with prompt history, prompt queu…☆26Aug 16, 2024Updated last year
- Datasette plugin for working with Apple's binary plist format☆14Feb 17, 2023Updated 3 years ago
- A terminal AI that doesn't babysit you. sot-cli gives LLMs full power, a novel memory architecture that slashes token costs, and agent or…☆39Jul 14, 2026Updated last week
- Benchmark your CLAUDE.md against your own PRs☆65Apr 6, 2026Updated 3 months ago
- Analyze Emails☆11Dec 8, 2022Updated 3 years ago
- Validated, private, shareable knowledge-graph memory for AI — per-tenant, write-gated, PostgreSQL-authoritative, served over MCP.☆18Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Cookiecutter template for making a cog for Red.☆12Jun 18, 2024Updated 2 years ago
- jmp - search files and jump to matching lines in a text editor☆13Apr 3, 2026Updated 3 months ago
- ContextCodeCache generator☆25Updated this week
- Library for reading the Macintosh File System☆11May 7, 2016Updated 10 years ago
- A ground-up LLM engineering project: tokenizer → architecture → training → scaling laws → inference. Starts at 80M, engineered to scale i…☆72Jan 29, 2026Updated 5 months ago
- MCP server for MediaWiki wikis - search, read, and edit wiki content from AI assistants☆19Updated this week
- proposition: general-purpose AppleScript libraries that ought to be included in OS X☆32Nov 29, 2016Updated 9 years ago
- Tracking the history of the FARA data from https://www.justice.gov/nsd-fara☆16Aug 3, 2023Updated 2 years ago
- a personality wrapper for Claude, Gemini, and Local AI Infra. YES! - more layers of abstraction :D☆16Jun 12, 2026Updated last month
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- My bookmark links which are worth to reade☆16Jan 22, 2026Updated 5 months ago
- ☆15Oct 2, 2025Updated 9 months ago
- forked from https://github.com/ohmyzsh/ohmyzsh/tree/master/plugins/systemd☆12Jun 1, 2021Updated 5 years ago
- Practical UNIX Manuals☆18Oct 22, 2019Updated 6 years ago
- EasyPattern is a readable alternative to regular expressions☆14May 13, 2013Updated 13 years ago
- cat files in style with vim☆15May 18, 2025Updated last year
- Vue.js playgrounds☆12Apr 22, 2024Updated 2 years ago
- Prioritize features for open source projects☆15Jul 25, 2020Updated 5 years ago
- This repo periodically pulls from the upstream Perplexica repo and pushes docker images to docker hub. For installation details check th…☆28Oct 8, 2025Updated 9 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- W3C ∕ Node.js☆12May 6, 2026Updated 2 months ago
- Simple configuration CLI generator for nodejs☆11Jan 6, 2023Updated 3 years ago
- ☆12Jan 7, 2025Updated last year
- Data on Digital Media and Technology Expenditures in the United States Congress☆10Jul 17, 2017Updated 9 years ago
- Cogs for Red-DiscordBot (v3), used by the SFU Anime Club. Branches for dpy1 and dpy2. See Injabie3/lui-cogs for Redv2/dpy0 cogs.☆14Nov 1, 2025Updated 8 months ago
- Tron Legacy colorscheme for common editors and terminal emulators☆11Feb 18, 2021Updated 5 years ago
- technicalmajority.com☆11May 2, 2017Updated 9 years ago