pacoxu / AI-InfraLinks
init to record my learning path of AI Infra, especially on inference.
☆127Updated this week
Alternatives and similar repositories for AI-Infra
Users that are interested in AI-Infra are comparing it to the libraries listed below
Sorting:
- Your AI Kubernetes Expert☆186Updated 2 years ago
- Kubernetes-native AI serving platform for scalable model serving.☆173Updated this week
- This project is designed to simulate GPU information, making it easier to test scenarios where a GPU is not available.☆64Updated 2 weeks ago
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆34Updated last week
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆75Updated 6 months ago
- katalyst aims to provide a universal solution to help improve resource utilization and optimize the overall costs in the cloud. This repo…☆52Updated 2 weeks ago
- Global control plane tracing for Kubernetes☆276Updated 2 months ago
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆286Updated last week
- A comprehensive tool for etcd diagnosis☆33Updated this week
- 围绕云原生知 识体系，收集一些不错的文章。仅供学习参考。☆53Updated 3 years ago
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆25Updated last year
- ALB (Another Load Balancer) is a Kubernetes Gateway powered by OpenResty with years of production experience from Alauda.☆68Updated 4 months ago
- Manage K8S like managing local files☆29Updated 2 years ago
- Fleetboard establishes an independent and unified parallel network, facilitating cross-cluster service discovery even in cases of IP over…☆31Updated 8 months ago
- A multi-cluster pod deletion protection webhook with high scalability and disaster tolerance☆40Updated 3 weeks ago
- kata 安全容器相关笔记，原理实战，开发进阶☆33Updated last year
- Declarative Workflow of KubeVela which can run as standalone.☆125Updated 2 months ago
- 中国开发者活动日程（关注点：开源、开发者、云原生）☆23Updated this week
- A federation scheduler for multi-cluster☆61Updated last week
- IOMesh Helm Charts Repo☆14Updated last year
- K8s Event Exporting, Filtering and Alerting in Multi-Tenant Environment☆215Updated 6 months ago
- Example DRA driver that developers can fork and modify to get them started writing their own.☆112Updated last week
- CAPK is a provider for Cluster API (CAPI) that allows users to deploy fake, Kubemark-backed machines to their clusters.☆88Updated 2 months ago
- A workload for deploying LLM inference services on Kubernetes☆160Updated this week
- API definitions for the crane project☆19Updated 6 months ago
- Load watcher is a cluster-wide aggregator of metrics, developed for Trimaran: Real Load Aware Scheduler in Kubernetes.☆77Updated last year
- etcd knowledge base☆60Updated 3 months ago
- ☆91Updated 9 months ago
- HTNN: A cloud-native gateway offering seamless extensibility for Istio and Envoy, in a native way by Go.☆123Updated 3 weeks ago
- KEE - Kubernetes Easy Engine☆424Updated 4 months ago