richardsliu / ray-on-gke
☆18Updated last year
Related projects ⓘ
Alternatives and complementary repositories for ray-on-gke
- ☆15Updated 5 months ago
- BigBertha is an architecture design that demonstrates how automated LLMOps (Large Language Models Operations) can be achieved on any Kube…☆26Updated last year
- Check for data drift between two OpenAI multi-turn chat jsonl files.☆36Updated 6 months ago
- MLOps Python Library☆116Updated 2 years ago
- ☆74Updated 5 months ago
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated last year
- MLFlow Deployment Plugin for Ray Serve☆42Updated 2 years ago
- Helm charts for the KubeRay project☆30Updated last month
- Distributed Model Serving Framework☆154Updated 3 weeks ago
- A Terraform module for running Kubeflow on a kubernetes cluster.☆20Updated 2 years ago
- Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods☆21Updated last month
- ☆37Updated 2 months ago
- Helm charts to deploy Weaviate to k8s☆50Updated this week
- Leverage your LangChain trace data for fine tuning☆37Updated 3 months ago
- Infrastructure as code for GPU accelerated managed Kubernetes clusters.☆47Updated 6 months ago
- Benchmark suite for LLMs from Fireworks.ai☆58Updated this week
- Command Line Interface for Hugging Face Inference Endpoints☆66Updated 7 months ago
- Large Language Model Hosting Container☆76Updated last week
- ☆41Updated last week
- This repository contains example integrations between Determined and other ML products☆47Updated 7 months ago
- Examples on how to use LangChain and Ray☆220Updated last year
- Controller for ModelMesh☆203Updated 3 months ago
- Three examples of recommendation system pipelines with NVIDIA Merlin and Redis☆56Updated last year
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆52Updated 7 months ago
- ☆63Updated 4 months ago
- Deploy and Scale LLM-based applications☆26Updated last year
- Helm chart repository for the new unified way to deploy ClearML on Kubernetes. ClearML - Auto-Magical CI/CD to streamline your AI workloa…☆36Updated last month
- Merlin Systems provides tools for combining recommendation models with other elements of production recommender systems (like feature sto…☆90Updated 4 months ago
- ☆75Updated 5 months ago
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆160Updated this week