openshift-psap / llm-load-testLinks
☆49Updated 2 months ago
Alternatives and similar repositories for llm-load-test
Users that are interested in llm-load-test are comparing it to the libraries listed below
Sorting:
- ☆19Updated last week
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆130Updated last week
- Helm charts for llm-d☆50Updated 3 months ago
- Resources, demos, recipes,... to work with LLMs on OpenShift with OpenShift AI or Open Data Hub.☆137Updated last month
- Achieve state of the art inference performance with modern accelerators on Kubernetes☆1,937Updated this week
- Model Registry provides a single pane of glass for ML model developers to index and manage models, versions, and ML artifacts metadata. I…☆149Updated this week
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆667Updated this week
- llm-d helm charts and deployment examples☆45Updated 3 weeks ago
- llm-d benchmark scripts and tooling☆30Updated this week
- Taxonomy tree that will allow you to create models tuned with your data☆285Updated last month
- Containerization and cloud native suite for OPEA☆70Updated 3 weeks ago
- Controller for ModelMesh☆237Updated 4 months ago
- Improve ROSA customer experience (and customer retention) by leveraging foundation models to do “gpt-chat” style search of Red Hat custo…☆27Updated last year
- Distributed Model Serving Framework☆177Updated 3 weeks ago
- Examples for building and running LLM services and applications locally with Podman☆180Updated 2 months ago
- NVIDIA DRA Driver for GPUs☆464Updated this week
- A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…☆196Updated last week
- MIG Partition Editor for NVIDIA GPUs☆219Updated this week
- Artifacts for the Distributed Workloads stack as part of ODH☆33Updated this week
- Repository to deploy LLMs with Multi-GPUs in distributed Kubernetes nodes☆27Updated 10 months ago
- InstaSlice Operator facilitates slicing of accelerators using stable APIs☆46Updated this week
- Red Hat Enterprise Linux AI -- Developer Preview☆166Updated last year
- Test Orchestrator for Performance and Scalability of AI pLatforms☆16Updated last week
- Repository to demo GPU Sharing with Time Slicing, MPS, MIG and others☆49Updated last year
- ☆258Updated last week
- Caikit is an AI toolkit that enables users to manage models through a set of developer friendly APIs.☆107Updated last week
- Collection of demos for building Llama Stack based apps on OpenShift☆55Updated last month
- ☆16Updated last week
- GenAI inference performance benchmarking tool☆106Updated last week
- Core repository for an AI-powered OCP assistant service☆58Updated this week