Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.
☆400Nov 1, 2026Updated this week
Alternatives and similar repositories for llm-inference-engineering
Users that are interested in llm-inference-engineering are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 100 days of LLM inference engineering — daily posts, experiments, and visualizations☆1,909Apr 30, 2026Updated 6 months ago
- AI System Design - Learn how to design AI systems built on LLMs, RAG, and AI Agents step by step.☆836Updated this week
- ☆144Oct 29, 2026Updated last week
- Learn AI Agents step by step, from scratch - from function calling to agent loops to multi-agent systems, orchestration, and evaluation.☆209Updated this week
- AI Engineer Roadmap - A step-by-step AI Engineering roadmap to become an AI Engineer, with a blog for every topic.☆336Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Learn LLM internals step by step - from tokenization to attention to inference optimization.☆1,769Updated this week
- Take the 100 Days of AI challenge - learn one AI concept a day, from machine learning basics to AI agents in production, in 100 days.☆71Oct 3, 2026Updated last month
- AI Engineering Course - A free and complete AI Engineering Course to learn AI Engineering step by step - from Machine Learning, Neural Ne…☆645Updated this week
- Transformer architecture explained step by step - the full architecture, every attention variant, positional embeddings, and every layer …☆230Jul 8, 2026Updated 3 months ago
- A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.☆4,336Oct 17, 2026Updated 2 weeks ago
- A 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization, speculative decoding, benchma…☆1,022Aug 14, 2026Updated 2 months ago
- GPU Engineering for AI Systems☆609May 17, 2026Updated 5 months ago
- A repo to learn system design from scratch.☆18Oct 28, 2026Updated last week
- Agent Harness prototype with main components and deployment on Railway☆27Aug 21, 2026Updated 2 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A 25.7M-parameter GLM-5.3-Flash-inspired model trained from scratch and improved with executable-reward RL.☆162Aug 28, 2026Updated 2 months ago
- Beginner-friendly awesome list and guides for Hermes Agent by Nous Research. Install, skills, memory, MCP, cron, workflows, security, and…☆22Updated this week
- Your Cheat Sheet for AI Engineering Interview – Questions and Answers.☆3,616Updated this week
- An intro to Braintrust and homework implementations using Braintrust as the backend☆34Mar 25, 2026Updated 7 months ago
- ☆104Oct 4, 2026Updated last month
- Next-Generation AI agent platform for autonomous software engineering with intelligent orchestration, persistent memory, Knowledge Graph,…☆18Oct 25, 2026Updated last week
- A practical learning series on building, grounding, extending, and evaluating AI agents for Microsoft 365 Copilot☆25Sep 16, 2026Updated last month
- Notes of the book System Desgin Interview - An Insider's Guide☆27,621Aug 12, 2026Updated 2 months ago
- Build a ChatGPT like LLM from scratch in PyTorch, explained step by step.☆386Jun 8, 2026Updated 4 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Your Cheat Sheet For AI Engineering Interviews at Top AI Companies - Questions and Answers.☆2,023Updated this week
- Forward Deployed Engineer Roadmap - A step-by-step roadmap to become a Forward Deployed Engineer (FDE) in AI, with a blog for every topic…☆234Updated this week
- Harness engineering beginner tutorial, from 0 to 1☆23,445Oct 22, 2026Updated 2 weeks ago
- Build your own X - Master machine learning by building everything from scratch. It aims to cover everything from linear regression to dee…☆775Jul 4, 2026Updated 4 months ago
- Learning notes for understanding modern Machine Learning System.☆66Oct 30, 2026Updated last week
- AI system design guide for engineers building production AI systems and evals.☆4,192Updated this week
- ☆10,039Jun 5, 2026Updated 5 months ago
- ☆12Aug 19, 2026Updated 2 months ago
- Twitter Clone Backend using Node.js, Express.js, MongoDB, Typescript with architecture layers - Router, Controller and Model☆29Jun 12, 2022Updated 4 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Production-grade MLOps: Model deployment, monitoring, feature stores, and ML pipelines for real-world AI systems.☆12Nov 10, 2025Updated 11 months ago
- ☆14Aug 7, 2026Updated 3 months ago
- A hands-on Swift and Metal course for building LLM inference from first principles on Apple silicon, with 48 guided lessons, runnable exe…☆194Jul 17, 2026Updated 3 months ago
- A Practitioner handbook for production llm serving.☆274Oct 27, 2026Updated last week
- Open-source AI demos you can understand, run, and remix — small, reproducible builds for vision, multimodal models, local or hosted infer…☆13Aug 18, 2026Updated 2 months ago
- This repository provides a working example of implementing Live Update Notifications on Android 16 ( Android U). It demonstrates how to l…☆17Aug 7, 2026Updated 2 months ago
- Using RAG to generate data for model fine-tuning.☆15Apr 16, 2025Updated last year