A production-grade LLM System Design platform & interactive lab. Features a pure-Python LLM serving, RAG, routing, safety, and agent control plane (150+ offline tests) plus a LangChain + Streamlit UI with local Ollama models.
☆22Jul 30, 2026Updated 3 months ago
Alternatives and similar repositories for llm-system-design
Users that are interested in llm-system-design are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The runnable companion to the ebook Cracking AI & ML Evaluation System Design Interviews.☆14Jul 31, 2026Updated 3 months ago
- A small, runnable reference implementation that accompanies Loop Engineering: A Practitioner's Guide. Each module maps to a chapter so yo…☆20Jul 30, 2026Updated 3 months ago
- Companion to Cracking the Forward Deployed AI Engineer Interview (2026 edition).☆14Aug 3, 2026Updated 3 months ago
- Harness Engineering for AI Coding Agents - Full Course Code, Specifications, aisuite Integration, and Dashboard☆13Oct 17, 2026Updated 3 weeks ago
- These are the sources for the upcoming book, 'Robot Framework Test Automation'☆13Feb 11, 2014Updated 12 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A First Look at Bugs in LLM Inference Engines☆11Feb 2, 2026Updated 9 months ago
- A comprehensive catalog of 34 Retrieval-Augmented Generation (RAG) techniques. Features Python pseudocode, pros/cons, and architecture co…☆75Feb 14, 2026Updated 8 months ago
- Just code, nothing else. A community VS Code chat extension on the Claude Agent SDK☆18Sep 17, 2026Updated last month
- This repository contains a detailed guide on how to implement DevOps in your organization. The playbook covers various aspects of DevOps,…☆16Aug 11, 2026Updated 3 months ago
- Production TypeSafe Jev (System One) use-case harnesses with confidence-gated decision logic☆28Sep 21, 2026Updated last month
- Code for the NeurIPS 2023 paper "Spatial-frequency channels, shape bias, and adversarial robustness"☆14Nov 5, 2023Updated 3 years ago
- A set of API adapters to work with the GOV.UK APIs☆22Updated this week
- ☆11Jul 14, 2025Updated last year
- A Repository for Algorithmic Mastery☆10Jul 13, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- This is a simple test of building a video RAG app with embedding Gemma 2 and Gemma-4-12B, served fully locally.☆18Oct 12, 2026Updated last month
- ☆10May 1, 2025Updated last year
- Open-source Legal AI workspace for evidence-grounded legal drafting, matter analysis and verifiable answers.☆68May 16, 2026Updated 5 months ago
- ☆12Feb 14, 2026Updated 8 months ago
- unformal implementation of advdiffuser☆17Feb 4, 2024Updated 2 years ago
- Huashu Design · English Port · HTML-Native Design Skills for Claude Code · HTML-Native Design Capabilities within Claude Code · High-Fide…☆16Updated this week
- Convert PDF to markdown with lightonai/LightOnOCR-2-1B☆13Jan 23, 2026Updated 9 months ago
- This MCP server uses mobsf api's to scan and analyze the apk and ipa files.☆24Sep 9, 2026Updated 2 months ago
- Self-tuning analog hardware with closed-loop optimization and fault-aware recovery.☆15Oct 6, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Example code for Blackice MX board written in nmigen☆12Jun 1, 2022Updated 4 years ago
- ☆18Aug 17, 2018Updated 8 years ago
- An open-source agentic ML ecosystem with a clean Python API, MCP server for AI agents, and a community Hub☆13Updated this week
- EMNLP 25 Oral - AdaSteer: Your Aligned LLM is Inherently an Adaptive Jailbreak Defender☆20Feb 7, 2026Updated 9 months ago
- Standalone PPTX-to-video skill and cross-platform CLI☆14Sep 16, 2026Updated last month
- Wishbone to ICAPE interface conversion☆14Mar 18, 2020Updated 6 years ago
- AI-bloat defense CLI for Python teams: deterministic code review, cleanup forecasts, and spec/contract evidence for AI-assisted and brown…☆18Updated this week
- KGRAG - KnowledgeGraph RAG☆10Updated this week
- embedded-vector-db is a lightweight npm package providing an embedded vector database solution for Node.js applications☆12Nov 29, 2025Updated 11 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Source for paper "Attacking Binarized Neural Networks"☆23Mar 23, 2018Updated 8 years ago
- Process Consistency Filter: Improve Reasoning Quality for LLM Reinforcement Learning☆11Sep 4, 2025Updated last year
- AdvDiffuser: Natural Adversarial Example Synthesis with Diffusion Models (ICCV 2023)☆19Jul 22, 2023Updated 3 years ago
- A KiCad pcbnew plugin that simulates and tunes PCB antennas on your real board with automatic simulation setup, generating a report that …☆16Oct 14, 2026Updated 3 weeks ago
- [AAAI 2026] This is the official implementation of the paper "ExtendAttack: Attacking Servers of LRMs via Extending Reasoning".☆27Mar 18, 2026Updated 7 months ago
- An unofficial Android SDK for Meizu MYVU AR glasses☆16Jul 21, 2026Updated 3 months ago
- How to create a production-ready AI app: A tutorial with code☆19Jul 4, 2026Updated 4 months ago
Are these results useful?