pacoxu / AI-InfraLinks
init to record my learning path of AI Infra, especially on inference.
☆83Updated this week
Alternatives and similar repositories for AI-Infra
Users that are interested in AI-Infra are comparing it to the libraries listed below
Sorting:
- Your AI Kubernetes Expert☆186Updated 2 years ago
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆24Updated 10 months ago
- A comprehensive tool for etcd diagnosis☆25Updated last month
- This project is designed to simulate GPU information, making it easier to test scenarios where a GPU is not available.☆54Updated 7 months ago
- agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes.☆118Updated this week
- 🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫☆219Updated this week
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆261Updated last week
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆70Updated 3 months ago
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆33Updated last week
- ALB (Another Load Balancer) is a Kubernetes Gateway powered by OpenResty with years of production experience from Alauda.☆68Updated last month
- Command-line tools for managing OCI model artifacts, which are bundled based on Model Spec☆45Updated this week
- 中国开发者活动日程（关注点：开源、开发者、云原生）☆21Updated this week
- Declarative Workflow of KubeVela which can run as standalone.☆124Updated 2 weeks ago
- Manage kubernetes node-level kernel tuning ( using sysctl ).☆30Updated last month
- CAPK is a provider for Cluster API (CAPI) that allows users to deploy fake, Kubemark-backed machines to their clusters.☆81Updated 3 weeks ago
- Kubernetes Operator for Kong Gateways☆83Updated this week
- caniuse.com, but for kubernetes☆26Updated 10 months ago
- The official Kubernetes operator for etcd.☆94Updated last week
- ✨Kubewizard is An AI-Agent for automated Kubernetes troubleshooting, and management, based on LangChain and k8s related tools.☆27Updated 9 months ago
- Manage K8S like managing local files☆29Updated 2 years ago
- Global control plane tracing for Kubernetes☆276Updated last week
- Kubernetes training from basics to advanced☆61Updated this week
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆24Updated 6 months ago
- 🎉 An awesome & curated list of best LLMOps tools.☆164Updated last week
- ☆17Updated 3 weeks ago
- Kubernetes 源码学习笔记 🔭☆23Updated 3 years ago
- Following the same workflows as Kubernetes. Widely used in InftyAI community.☆13Updated 3 months ago
- A QA system based on k8s-specific knowledge build on ChatGLM2-6B, serving by Ray.☆10Updated 2 years ago
- Kubernetes APIServer 高性能代理组件，代理 APIServer 的 List 请求，其它类型的请求会直接反向代理到原生 APIServer。 CKube 还额外支持了分页、搜索和索引等功能。 并且，CKube 100% 兼容原生 kubectl 和 ku…☆19Updated 3 years ago
- ☆13Updated this week