openshift-psap / llm-load-testLinks
☆47Updated 3 weeks ago
Alternatives and similar repositories for llm-load-test
Users that are interested in llm-load-test are comparing it to the libraries listed below
Sorting:
- ☆19Updated this week
- llm-d is a Kubernetes-native high-performance distributed LLM inference framework☆1,656Updated this week
- Helm charts for llm-d☆51Updated last month
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆124Updated last week
- Resources, demos, recipes,... to work with LLMs on OpenShift with OpenShift AI or Open Data Hub.☆135Updated last month
- Red Hat Enterprise Linux AI -- Developer Preview☆166Updated last year
- This project makes running the InstructLab large language model (LLM) fine-tuning process easy and flexible on OpenShift☆27Updated last month
- ☆238Updated this week
- Distributed Model Serving Framework☆175Updated last week
- Repository to deploy LLMs with Multi-GPUs in distributed Kubernetes nodes☆25Updated 8 months ago
- Model Registry provides a single pane of glass for ML model developers to index and manage models, versions, and ML artifacts metadata. I…☆147Updated this week
- Collection of demos for building Llama Stack based apps on OpenShift☆53Updated this week
- Artifacts for the Distributed Workloads stack as part of ODH