AI 基础知识 - GPU 架构、CUDA 编程、大模型基础及AI Agent 相关知识。
☆1,290May 23, 2026Updated this week
Alternatives and similar repositories for AI-fundamentals
Users that are interested in AI-fundamentals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 动手学机器学习☆37Feb 1, 2026Updated 3 months ago
- Kubernetes 动手教程☆15May 18, 2026Updated last week
- AIInfra(AI 基础设施)指AI系统从底层芯片等硬件,到上层软件栈支持AI大模型训练和推理。☆7,099Dec 22, 2025Updated 5 months ago
- Kubernetes-native AI serving platform for scalable model serving.☆350Updated this week
- kubectl plugin☆14Feb 25, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆5,401Updated this week
- ☆20Mar 11, 2026Updated 2 months ago
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆727Updated this week
- AISystem 主要是指AI系统,包括AI芯片、AI编 译器、AI推理和训练框架等AI全栈底层技术☆16,784Sep 3, 2025Updated 8 months ago
- Heterogeneous GPU Sharing on Kubernetes☆3,475Updated this week
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆305Jan 26, 2026Updated 4 months ago
- Multi-Cluster application progressive delivery controller☆21May 13, 2026Updated 2 weeks ago
- ☆358Updated this week
- 通过实验对比LLM推理中Prefill和Decoding阶段的吞吐量差异,揭示性能瓶颈,解释PD分离优化技术的原理。包含CUDA和Apple MPS (M系列芯片) 的测试脚本。☆22May 22, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Network monitoring & diagnosis suite for Kubernetes☆685Apr 9, 2026Updated last month
- Some common CUDA kernel implementations (Not the fastest).☆29Dec 5, 2025Updated 5 months ago
- Provides deploy scripts and CSI for Lustre.☆14Apr 13, 2026Updated last month
- 📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉☆11,050May 17, 2026Updated last week
- 《使用云原生技术进行软件开发》课程课件☆27Aug 29, 2025Updated 8 months ago
- A Datacenter Scale Distributed Inference Serving Framework☆6,941Updated this week
- An eBPF kernel Observable Agent To Spy Performance Issue On OS.☆13Oct 31, 2025Updated 6 months ago
- A workload for deploying LLM inference services on Kubernetes☆219May 20, 2026Updated last week
- All-in-one benchmarking platform for evaluating LLM.☆15Nov 12, 2025Updated 6 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- NVIDIA Inference Xfer Library (NIXL)☆1,041Updated this week
- 本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)☆24,353May 10, 2026Updated 2 weeks ago
- An example of how to use the kubernetai plugin to do multicluster DNS-based service discovery☆10Nov 21, 2019Updated 6 years ago
- qwen2 and llama3 cpp implementation☆50Jun 7, 2024Updated last year
- [EMNLP 2024] TraveLER: A Modular Multi-LMM Agent Framework for Video Question-Answering☆18Oct 31, 2024Updated last year
- Supercharge Your LLM with the Fastest KV Cache Layer☆8,345Updated this week
- FlashInfer: Kernel Library for LLM Serving☆5,666Updated this week
- This project is designed to simulate GPU information, making it easier to test scenarios where a GPU is not available.☆65Jan 9, 2026Updated 4 months ago
- To better understand the ggml library☆27Jun 13, 2025Updated 11 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Prototypes and experiments for WG Device Management.☆15Updated this week
- ClusterKV: Manipulating LLM KV Cache in Semantic Space for Recallable Compression (DAC'25)☆28Feb 26, 2026Updated 3 months ago
- Kubernetes APIServer 高性能代理组件,代理 APIServer 的 List 请求,其它类型的请求会直接反向代理到原生 APIServer。 CKube 还额外支持了分页、搜索和索引等功能。 并且,CKube 100% 兼容原生 kubectl 和 ku…☆19Sep 16, 2022Updated 3 years ago
- tony k8s device-plugin,一个简单的 k8s device-plugin 实现以及原理分析教程。☆29Mar 29, 2025Updated last year
- Awesome DaoCloud Microservices Platform Document☆12Dec 24, 2020Updated 5 years ago
- My learning notes for ML SYS.☆6,354Updated this week
- A QoS-based scheduling system brings optimal layout and status to workloads such as microservices, web services, big data jobs, AI jobs, …☆1,692Updated this week