GPU Engineering for AI Systems
☆606May 17, 2026Updated 5 months ago
Alternatives and similar repositories for awesome-gpu-engineering
Users that are interested in awesome-gpu-engineering are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.☆4,296Oct 17, 2026Updated last week
- Learn LLM internals step by step - from tokenization to attention to inference optimization.☆1,772Updated this week
- ☆4,161Mar 11, 2026Updated 7 months ago
- 100 days of LLM inference engineering — daily posts, experiments, and visualizations☆1,890Apr 30, 2026Updated 6 months ago
- 🚀🚀🚀 This repository lists some awesome public CUDA, cuda-python, cuBLAS, cuDNN, CUTLASS, TensorRT, TensorRT-LLM, Triton, TVM, MLIR, PT…☆522Aug 2, 2025Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- This repository contains a curated collection of 300+ case studies from over 80 companies, detailing practical applications and insights …☆11,074Aug 5, 2025Updated last year
- A 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization, speculative decoding, benchma…☆1,011Aug 14, 2026Updated 2 months ago
- Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.☆389Oct 5, 2026Updated 3 weeks ago
- A complete roadmap to master LLMs from absolute beginners to advanced☆529Sep 10, 2026Updated last month
- Exploring GPU programming with CUDA from fundamentals to advanced kernels.☆88Updated this week
- This repository contains python code for different data structures and algorithms.☆25May 27, 2020Updated 6 years ago
- Visual Instruction Tuning towards General-Purpose Multimodal Model: A Survey☆12Feb 16, 2024Updated 2 years ago
- Code, labs, and resources for O'Reilly AI Systems Performance Engineering: GPU optimization, distributed training, inference scaling, and…☆2,124Updated this week
- Build a ChatGPT like LLM from scratch in PyTorch, explained step by step.☆385Jun 8, 2026Updated 4 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Machine Learning Systems: Foundations, Scaling, Agentic AI, and Physical AI (Vols I–IV) • Harvard CS249r | https://mlsysbook.ai☆29,728Updated this week
- Multimodal AI workloads: batch inference, model training and online serving.☆111Aug 22, 2025Updated last year
- Introduction to PyTorch, covering tensor initialization, operations, indexing, and reshaping.☆1,056Jan 6, 2026Updated 9 months ago
- GPU CI/CD tool that tests CUDA kernels across multiple GPUs in parallel - Part of RightNow☆15Jan 25, 2026Updated 9 months ago
- "LLM from Zero to Hero: An End-to-End Large Language Model Journey from Data to Application!"☆153Aug 24, 2026Updated 2 months ago
- A CUDA Python experiment demonstrating kernel fusion by combining ReLU and LayerNorm into a single GPU pass and comparing it against the …☆14Feb 28, 2026Updated 8 months ago
- A curated list of 100+ libraries and frameworks for AI engineers building with LLMs☆3,398May 11, 2026Updated 5 months ago
- A group of notebooks and other files which can help you learn AI from scratch.☆1,464Oct 3, 2026Updated 3 weeks ago
- A curated collection of practical AI projects implementing OCR systems, RAG, AI agents, and other AI use cases.☆4,062Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A small, readable PyTorch inference engine for Qwen3-4B with continuous batching, native paged attention, prefix caching, and an OpenAI-c…☆18Updated this week
- An MLIR-based compiler that takes GPU kernels and compiles them to real hardware instructions. Interactive web visualizer included.☆148Mar 21, 2026Updated 7 months ago
- ☆770Updated this week
- AI Infrastructure Engineer Learning Track - Production ML infrastructure curriculum (2-4 years experience)☆1,836Jun 26, 2026Updated 4 months ago
- Ground Truth - A working developer's path into AI and machine learning.☆38Oct 10, 2026Updated 2 weeks ago
- Master AI inference, AI agent harness systems, and hardware engineering — then design a physical AI chip. That is the goal.☆296Updated this week
- ☆9,994Jun 5, 2026Updated 4 months ago
- A comprehensive, curated collection of resources for learning Machine Learning, Deep Learning, and AI☆188Mar 10, 2025Updated last year
- ☆41Sep 16, 2026Updated last month
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- This is the official repository for the book Transformers - The Definitive Guide☆475Aug 5, 2026Updated 2 months ago
- Complete solutions to the Programming Massively Parallel Processors Edition 4☆908Sep 7, 2026Updated last month
- AI system design guide for engineers building production AI systems and evals.☆4,098Oct 8, 2026Updated 3 weeks ago
- Machine Learning Engineering Open Book☆19,630Updated this week
- Official code repo for the O'Reilly Book - "Hands-On Large Language Models"☆29,954Apr 24, 2026Updated 6 months ago
- Curated collection of AI inference engineering resources — LLM serving, GPU kernels, quantization, distributed inference, and production …☆357Feb 4, 2026Updated 8 months ago
- 🔥 LeetCode for PyTorch — practice implementing softmax, attention, GPT-2 and more from scratch with instant auto-grading. Jupyter-based,…☆4,712Jul 31, 2026Updated 2 months ago