LLM system design interview guide: RAG, KV cache, agents, serving, evals, guardrails. Architectures open live as validated reference graphs.
☆31Sep 7, 2026Updated last month
Alternatives and similar repositories for awesome-llm-system-design
Users that are interested in awesome-llm-system-design are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- AI Engineer interview prep for 2026: 267 real questions, 10 worked system designs, 12 company guides (OpenAI, Anthropic, DeepMind and mor…☆33Updated this week
- ☆15Feb 11, 2025Updated last year
- Design of in-memory database☆15Aug 4, 2024Updated 2 years ago
- ☆10Apr 2, 2024Updated 2 years ago
- Compile git commits into a "Chronicle"☆28Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This is a 3D jewels website using Three.js & WebGi engine.☆24Aug 25, 2023Updated 3 years ago
- 💡 Grasp - Pick-and-place with a robotic hand 👨🏻💻☆13Dec 15, 2023Updated 2 years ago
- CLI application to fetch your Twitter bookmarks using Playwright☆17Mar 4, 2023Updated 3 years ago
- This Guidance helps businesses build a real-time recommendation pipeline using Amazon Personalize☆17Aug 28, 2025Updated last year
- asAgent brings chat, browser assistance, scheduled tasks, and reversible file operations into one desktop app.☆28Sep 5, 2026Updated last month
- Netvlad using lightweight framework mobilenetv2 for feature extraction！Created by Ze Huang.☆18Feb 16, 2021Updated 5 years ago
- CITS4407 website. Visit https://cits4407.github.io/ to view it☆11Apr 12, 2023Updated 3 years ago
- Example code for showing the awesomeness of web dev☆35May 17, 2024Updated 2 years ago
- Taste-Bench: measuring the long-horizon judgment of LLM agents at real decision forks☆39Sep 23, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- AI Agentic Trader☆31Nov 3, 2025Updated 11 months ago
- OneDayAgent: Towards a Long-Horizon Harness for Autonomous Agents☆37Aug 15, 2026Updated 2 months ago
- End of Day historical data for NSE stocks in csv format. Updated weekly.☆31Oct 14, 2026Updated last week
- Data Wiki turns data into portable knowledge bundles following Open Knowledge Format (OKF) and serves them to AI agents over the Model Co…☆33Oct 15, 2026Updated last week
- ☆20Apr 22, 2025Updated last year
- Reinforcement Learning Project☆19May 3, 2023Updated 3 years ago
- [ICLR 2024] EX-Graph: A Pioneering Dataset Bridging Ethereum and X https://openreview.net/pdf?id=juE0rWGCJW☆22Sep 30, 2024Updated 2 years ago
- A complete collection of RAG interview questions, answers (1509 questions & 52 RAG types), system design scenarios, architecture patterns…☆169Oct 10, 2026Updated last week
- p-checker: The one-for-all p-value analyzer. R-Index, p-curve, and more in one online app.☆12Sep 23, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A custom made crypto orderbook indicator displaying in your terminal☆17Apr 12, 2023Updated 3 years ago
- Here you can find community content around Cilium☆27Updated this week
- Codes of Improving Neural Surface Reconstruction with Feature Priors from Multi-View Images (ECCV2024)☆20Aug 7, 2024Updated 2 years ago
- ☆12Updated this week
- ZKP2P V2 escrow protocol contracts☆26Updated this week
- GenAI evaluation framework, optimized for 100x lower cost 🚀.☆46Sep 28, 2026Updated 3 weeks ago
- a simple shell to imitate linux_shell written in C(linux) for BUAA-Unix-Lecture 2021☆15Aug 24, 2021Updated 5 years ago
- The tool to visualise architecture of python packages☆10Aug 16, 2023Updated 3 years ago
- Free resources for building persistent memory into AI agents☆38Oct 9, 2026Updated 2 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 基于Logisim的RISC-V五段流水CPU，支持重定向流水线和单周期多中断☆18Aug 31, 2022Updated 4 years ago
- Helix's mission: optimize harnesses for models, then automatically turn harness-generated rollouts into trainable agent data.☆52Aug 17, 2026Updated 2 months ago
- High-speed, Internet-scale, load-balanced paths discovery.☆21Oct 8, 2026Updated 2 weeks ago
- 半导体器件物理 LaTeX笔记☆17Apr 19, 2025Updated last year
- What the f*ck Python?☆12Jun 10, 2020Updated 6 years ago
- UWA Introduction to Cybersecurity☆24Oct 9, 2021Updated 5 years ago
- Notes on how to set up your backend instance☆11May 29, 2024Updated 2 years ago