Alternatives and similar repositories for ai-infra-landscape

Users that are interested in ai-infra-landscape are comparing it to the libraries listed below

• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆122Updated last week
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆269Updated last year
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆129Updated last month
• kserve / open-inference-protocol
  Repository for open inference protocol specification
  ☆56Updated last month
• skai-x / elastic-jupyter-operator
  Cloud-native way to provide elastic Jupyter Notebooks on Kubernetes. Run remote kernels, natively.
  ☆201Updated 3 years ago
• substratusai / runbooks
  Finetune LLMs on K8s by using Runbooks
  ☆170Updated 9 months ago
• prem-research / prem-operator
  📡 Deploy AI models and apps to Kubernetes without developing a hernia
  ☆32Updated last year
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆67Updated last year
• kubeagi / arcadia
  A diverse, simple, and secure all-in-one LLMOps platform
  ☆105Updated 9 months ago
• llmariner / llmariner
  Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.
  ☆82Updated this week
• NVIDIA / knavigator
  knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.
  ☆67Updated last month
• ray-project / kuberay-helm
  Helm charts for the KubeRay project
  ☆44Updated this week
• BaizeAI / kcover
  🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.
  ☆30Updated 6 months ago
• project-codeflare / multi-cluster-app-dispatcher
  Holistic job manager on Kubernetes
  ☆116Updated last year
• cnvrg / metagpu
  K8s device plugin for GPU sharing
  ☆98Updated 2 years ago
• amogkam / llama_index_ray
  Using LlamaIndex with Ray for productionizing LLM applications
  ☆71Updated last year
• flavienbwk / awesome-llm-devops
  A list of DevOps features enabled by awesome LLM software.
  ☆54Updated 9 months ago
• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆114Updated this week
• NVIDIA / KAI-Scheduler
  KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale
  ☆656Updated this week
• run-ai / runai-model-streamer
  ☆221Updated this week
• rubra-ai / rubra
  Open Weight, tool-calling LLMs
  ☆152Updated 8 months ago
• kubernetes-sigs / jobset
  JobSet: a k8s native API for distributed ML training and HPC workloads
  ☆236Updated last week
• langfuse / oss-llmops-stack
  Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…
  ☆105Updated 4 months ago
• unifyai / aibench-llm-endpoints
  Runner in charge of collecting metrics from LLM inference endpoints for the Unify Hub
  ☆17Updated last year
• xetdata / xet-core
  Rust crates for XetHub
  ☆43Updated 8 months ago
• amikos-tech / chromadb-chart
  Chart for deploying ChromaDB in Kubernetes
  ☆49Updated last month
• gptscript-ai / knowledge
  Knowledge for GPTScript
  ☆29Updated 7 months ago
• elastic-ai / elastic-gpu-scheduler
  elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.
  ☆141Updated 2 years ago
• kubernetes-sigs / inference-perf
  GenAI inference performance benchmarking tool
  ☆58Updated this week
• weaviate / weaviate-helm
  Helm charts to deploy Weaviate to k8s
  ☆59Updated last month