pacoxu / AI-InfraLinks
init to record my learning path of AI Infra, especially on inference.
☆27Updated this week
Alternatives and similar repositories for AI-Infra
Users that are interested in AI-Infra are comparing it to the libraries listed below
Sorting:
- Your AI Kubernetes Expert☆183Updated 2 years ago
- This project is designed to simulate GPU information, making it easier to test scenarios where a GPU is not available.☆48Updated 4 months ago
- 中国开发者活动日程（关注点：开源、开发者、云原生）☆16Updated this week
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆24Updated 7 months ago
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆30Updated last week
- A comprehensive tool for etcd diagnosis☆25Updated last week
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆20Updated 2 months ago
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆67Updated 2 months ago
- Manage K8S like managing local files☆29Updated 2 years ago
- OpenCIDN (Open Container Image Deliver Network)☆27Updated 2 weeks ago
- Kubernetes 源码学习笔记 🔭☆22Updated 3 years ago
- 围绕云原生知识体系，收集一些不错的文章。仅供学习参考。☆53Updated 3 years ago
- ☆17Updated this week
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆12Updated 2 years ago
- caniuse.com, but for kubernetes☆24Updated 6 months ago
- Collect Repos Star/Fork/Watch Counts Everyday☆16Updated this week
- 🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫☆196Updated this week
- Command-line tools for managing OCI model artifacts, which are bundled based on Model Spec☆30Updated this week
- Declarative Workflow of KubeVela which can run as standalone.☆122Updated 2 weeks ago
- Following the same workflows as Kubernetes. Widely used in InftyAI community.☆13Updated last week
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆219Updated this week
- ALB (Another Load Balancer) is a Kubernetes Gateway powered by OpenResty with years of production experience from Alauda.☆65Updated last week
- HTNN: A cloud-native gateway offering seamless extensibility for Istio and Envoy, in a native way by Go.☆116Updated 2 weeks ago
- Kubernetes APIServer 高性能代理组件，代理 APIServer 的 List 请求，其它类型的请求会直接反向代理到原生 APIServer。 CKube 还额外支持了分页、搜索和索引等功能。 并且，CKube 100% 兼容原生 kubectl 和 ku…☆19Updated 2 years ago
- katalyst aims to provide a universal solution to help improve resource utilization and optimize the overall costs in the cloud. This repo…☆46Updated last week
- [Moved to https://github.com/kubernetes-sigs/kwok] This is a fake kubelet. that can simulate any number of nodes and maintain pods on tho…☆64Updated 2 years ago
- Dragonfly Helm Charts☆37Updated this week
- Fleetboard establishes an independent and unified parallel network, facilitating cross-cluster service discovery even in cases of IP over…☆27Updated 2 months ago
- A network tunnel used to proxy Kubernetes API requests to member clusters☆16Updated 3 years ago
- Client library with golang for accessing Harbor API.☆45Updated 2 weeks ago