AI Infrastructure Performance Engineer Learning Track - GPU optimization, inference optimization, and cost reduction
☆82Nov 8, 2026Updated 2 weeks ago
Alternatives and similar repositories for ai-infra-performance-learning
Users that are interested in ai-infra-performance-learning are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High-performance CUDA inference engine for Qwen models, written from scratch in C++/CUDA☆14Oct 14, 2026Updated last month
- AI Infrastructure Engineer Learning Track - Production ML infrastructure curriculum (2-4 years experience)☆1,907Nov 3, 2026Updated 2 weeks ago
- This repository documents my 100-day journey of learning and writing CUDA kernels.☆36Mar 29, 2026Updated 7 months ago
- RhinoForge is an open-source development, deployment, and inference stack for Rhino RPU. It helps developers bring PyTorch models, existi…☆18Updated this week
- Deep Learning at Scale @ SC25☆18Sep 9, 2026Updated 2 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆65Sep 27, 2026Updated last month
- ☆11May 5, 2023Updated 3 years ago
- A do-framework project to simplify deployment of Kubeflow on Amazon EKS☆23Feb 18, 2025Updated last year
- Configurable deep research engine☆28Oct 18, 2026Updated last month
- FlagGems-sglang is part of FlagOS. It is a high-performance operator library designed for multiple hardware backends.☆22Updated this week
- [AAAI 2026] The official code for ``LoopLLM: Transferable Energy-Latency Attacks in LLMs via Repetitive Generation''☆17Mar 20, 2026Updated 8 months ago
- 《自己动手写AI编译器》☆49Oct 19, 2024Updated 2 years ago
- A production-grade LLM System Design platform & interactive lab. Features a pure-Python LLM serving, RAG, routing, safety, and agent cont…☆22Jul 30, 2026Updated 3 months ago
- Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang so…☆2,307Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- A local proxy to intercept and replace standard CLI or BYOK authentication with Kiro/AWS creds... basically letting Claude Code operate i…☆27Mar 11, 2026Updated 8 months ago
- Kiro API proxy with OpenAI and Anthropic compatible endpoints☆28Jul 31, 2026Updated 3 months ago
- Speed-of-Light SW efficiency by using ultra low-latency primitives for comms collectives☆13Apr 8, 2026Updated 7 months ago
- ☆12May 8, 2026Updated 6 months ago
- Create and manage Amazon SageMaker HyperPod clusters, run distributed model training☆26Updated this week
- Tool to create namespaces and service accounts that can safely be handed to CI or users.☆10Nov 8, 2026Updated 2 weeks ago
- 笔记整理 Skill:一个用于 Claude Code 的课程资料、PDF、PPT、题库整理成 Markdown/Obsidian 复习笔记的 Claude Skill。☆18Jun 30, 2026Updated 4 months ago
- Code, labs, and resources for O'Reilly AI Systems Performance Engineering: GPU optimization, distributed training, inference scaling, and…☆2,233Updated this week
- LLM KV Cache compression - K+V dual compression, 73-99% VRAM savings, zero accuracy loss☆58Mar 30, 2026Updated 7 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Dashboard for InferenceX™, Open Source Continuous Inference | InferenceX 仪表板☆50Updated this week
- Dijkstra's Algorithm implemented in C/C++ using standard C, OpenMP and CUDA☆13Dec 12, 2015Updated 10 years ago
- 当软件系统的核心组件从确定性函数变成概率性语言模型,软件工程的基本原则会发生什么变化,又有什么不会变。☆12Jun 9, 2026Updated 5 months ago
- GEMM☆10Aug 26, 2023Updated 3 years ago
- ☆12Jun 20, 2024Updated 2 years ago
- Repository for the Sencha Game Engine.☆14Updated this week
- Two case studies: megakernels roughly on par with CUDA Graphs + PDL. Code and baselines for further research.☆13Nov 6, 2026Updated 2 weeks ago
- ☆12Jul 23, 2026Updated 3 months ago
- ☆61Mar 15, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A Codex-like coding agent. Ask Amadeus to do anything☆13Sep 13, 2026Updated 2 months ago
- ☆11Jun 20, 2025Updated last year
- weifan architecture coaching skill - turn AI Q&A into mental-model building (SKILL.md standard, bilingual zh/en)☆13Nov 8, 2026Updated 2 weeks ago
- ☆11May 16, 2026Updated 6 months ago
- This is an official pytorch implementation of 'Group-wise Inhibition based Feature Regularization for Robust Classification' (ICCV 2021 a…☆10Dec 10, 2022Updated 3 years ago
- Optimize SGEMM step by step☆10Sep 4, 2024Updated 2 years ago
- A Chinese-focused PyTorch framework for exploring Attention Residuals in Qwen3-style causal LMs, with baseline, Block AttnRes, Full AttnR…☆21May 3, 2026Updated 6 months ago
Are these results useful?