Alternatives and similar repositories for Enterprise-Inference

Users that are interested in Enterprise-Inference are comparing it to the libraries listed below

• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆141Updated this week
• AI-Hypercomputer / inference-benchmark
  ☆17Updated 6 months ago
• sustainable-computing-io / kepler-model-server
  Model Server for Kepler
  ☆29Updated 2 months ago
• kubernetes / dynamic-resource-allocation
  ☆39Updated this week
• NVIDIA / nim-deploy
  A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…
  ☆216Updated last week
• NVIDIA / k8s-operator-libs
  A collection of useful Go libraries to ease the development of NVIDIA Operators for GPU/NIC management.
  ☆25Updated 3 weeks ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆131Updated 2 months ago
• opea-project / GenAIInfra
  Containerization and cloud native suite for OPEA
  ☆72Updated 2 months ago
• llm-d / llm-d-deployer
  Helm charts for llm-d
  ☆50Updated 4 months ago
• Climatik-Project / Climatik-Project
  Carbon Limiting Auto Tuning for Kubernetes
  ☆37Updated last year
• NVIDIA / topograph
  A toolkit for discovering cluster network topology.
  ☆86Updated last week
• NVIDIA / gpu-driver-container
  The NVIDIA GPU driver container allows the provisioning of the NVIDIA driver through the use of containers.
  ☆148Updated this week
• intel / ai-containers
  This repository contains Dockerfiles, scripts, yaml files, Helm charts, etc. used to scale out AI containers with versions of TensorFlow …
  ☆56Updated this week
• kubernetes-sigs / wg-serving
  WG Serving
  ☆32Updated last week
• foundation-model-stack / multi-nic-cni
  ☆40Updated 2 weeks ago
• fmperf-project / fmperf
  Cloud Native Benchmarking of Foundation Models
  ☆44Updated 4 months ago
• opea-project / GenAIStudio
  GenAI Studio is a low code platform to enable users to construct, evaluate, and benchmark GenAI applications. The platform also provide c…
  ☆55Updated 2 weeks ago
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆193Updated 7 months ago
• NVIDIA / cloud-native-stack
  Run cloud native workloads on NVIDIA GPUs
  ☆210Updated 2 months ago
• opea-project / GenAIComps
  GenAI components at micro-service level; GenAI service composer to create mega-service
  ☆190Updated this week
• ibm-granite / watsonx-code-assistant-individual
  For individual users, watsonx Code Assistant can access a local IBM Granite model
  ☆37Updated 5 months ago
• project-codeflare / instaslice
  InstaSlice facilitates the use of Dynamic Resource Allocation (DRA) on Kubernetes clusters for GPU sharing
  ☆30Updated last year
• openshift-psap / topsail
  Test Orchestrator for Performance and Scalability of AI pLatforms
  ☆16Updated this week
• opea-project / docs
  This repo contains documents of the OPEA project
  ☆43Updated 3 months ago
• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆175Updated 2 weeks ago
• opendatahub-io / caikit-tgis-serving
  ☆20Updated this week
• kubernetes-sigs / inference-perf
  GenAI inference performance benchmarking tool
  ☆137Updated 2 weeks ago
• IBM / autopilot
  A tool to detect infrastructure issues on cloud native AI systems
  ☆52Updated 3 months ago
• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆119Updated this week
• Azure / azurehpc-health-checks
  Health checks for Azure N- and H-series VMs.
  ☆55Updated 2 weeks ago