InftyAI / Awesome-LLMOps

Related projects ⓘ

Alternatives and complementary repositories for Awesome-LLMOps

• InftyAI / llmaz
  ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
  ☆30Updated last week
• kubeagi / arcadia
  A diverse, simple, and secure all-in-one LLMOps platform
  ☆86Updated 2 months ago
• kubevela / prism
  API Extensions for core KubeVela.
  ☆12Updated last week
• DaoCloud / karmada-operator1
  ☆12Updated last year
• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆58Updated this week
• nekomeowww / ollama-operator
  Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫
  ☆113Updated 2 weeks ago
• premAI-io / prem-operator
  📡 Deploy AI models and apps to Kubernetes without developing a hernia
  ☆31Updated 6 months ago
• open-cluster-management-io / cluster-proxy
  An OCM addon that automates the installation of Kubernetes' konnectivity servers and agents.
  ☆46Updated 2 weeks ago
• copilot-io / runtime-copilot
  The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…
  ☆12Updated last year
• gptscript-ai / knowledge
  Knowledge for GPTScript
  ☆29Updated 3 weeks ago
• makllama / makllama
  MaK(Mac+Kubernetes)llama - Running and orchestrating large language models (LLMs) on Kubernetes with macOS nodes.
  ☆28Updated 6 months ago
• feiskyer / ChatGPT-Reviewer
  Automated pull requests reviewing and issues triaging with ChatGPT.
  ☆69Updated 9 months ago
• kubernetes / dynamic-resource-allocation
  ☆28Updated this week
• tensorchord / envd-server
  Backend server for envd
  ☆21Updated 11 months ago
• kubernetes-sigs / lws
  LeaderWorkerSet: An API for deploying a group of pods as a unit of replication
  ☆142Updated this week
• kubevela / kube-trigger
  kube-trigger watches events and triggers actions in a programmable way.
  ☆52Updated last year
• NVIDIA / knavigator
  knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.
  ☆55Updated 2 weeks ago
• kubernetes-sigs / dra-example-driver
  Example DRA driver that developers can fork and modify to get them started writing their own.
  ☆53Updated 2 weeks ago
• kubernetes-sigs / wg-serving
  WG Serving
  ☆14Updated 3 weeks ago
• BaizeAI / kcover
  ☆25Updated 2 months ago
• dragonflyoss / helm-charts
  Dragonfly Helm Charts
  ☆32Updated this week
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆54Updated 7 months ago
• flomesh-io / ErieCanal
  ErieCanal is a MCS(multi cluster service https://github.com/kubernetes-sigs/mcs-api) implementation, provides MCS, Ingress, Egress, Gatew…
  ☆51Updated last year
• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆18Updated 4 months ago
• zilliztech / milvus-operator
  The Kubernetes Operator of Milvus.
  ☆55Updated this week
• kubean-io / kube-node-tuning
  Manage kubernetes node-level kernel tuning ( using sysctl ).
  ☆26Updated last year
• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆130Updated last month
• deepflowio / deepflow-charts
  An automated observability platform for cloud-native developers.
  ☆11Updated 3 weeks ago
• langchain-ai / helm
  Repository hosting Langchain helm charts.
  ☆41Updated this week