openshift-psap / llm-load-testLinks
☆43Updated 2 months ago
Alternatives and similar repositories for llm-load-test
Users that are interested in llm-load-test are comparing it to the libraries listed below
Sorting:
- Helm charts for llm-d☆35Updated this week
- This project makes running the InstructLab large language model (LLM) fine-tuning process easy and flexible on OpenShift☆26Updated last week
- Repository to demo GPU Sharing with Time Slicing, MPS, MIG and others☆42Updated 7 months ago
- Model Registry provides a single pane of glass for ML model developers to index and manage models, versions, and ML artifacts metadata. I…☆128Updated this week
- Resources, demos, recipes,... to work with LLMs on OpenShift with OpenShift AI or Open Data Hub.☆124Updated 3 weeks ago
- InstaSlice Operator facilitates slicing of accelerators using stable APIs☆35Updated this week
- ☆19Updated this week
- ☆16Updated this week
- Repository to deploy LLMs with Multi-GPUs in distributed Kubernetes nodes☆23Updated 5 months ago
- Models as a Service☆59Updated last week
- Test Orchestrator for Performance and Scalability of AI pLatforms☆14Updated this week
- Source for the "Parasol Insurance" Lab☆72Updated this week
- Collection of demos for building Llama Stack based apps on OpenShift☆33Updated last week
- Artifacts for the Distributed Workloads stack as part of ODH☆31Updated last week
- GenAI inference performance benchmarking tool☆45Updated this week
- AI-on-OpenShift website source code☆84Updated last month
- Examples for building and running LLM services and applications locally with Podman☆158Updated this week
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆107Updated this week
- The AI Accelerator is a template project for setting up Red Hat OpenShift AI using GitOps☆53Updated 2 weeks ago
- llm-d is a Kubernetes-native high-performance distributed LLM inference framework☆987Updated this week
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆317Updated this week
- Open Data Hub operator to manage ODH component integrations☆78Updated this week
- 🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.☆44Updated this week
- ODH Tools & Extensions Companion☆21Updated last week
- Improve ROSA customer experience (and customer retention) by leveraging foundation models to do “gpt-chat” style search of Red Hat custo…☆27Updated last year
- IBM development fork of https://github.com/huggingface/text-generation-inference☆60Updated 3 weeks ago
- ☆24Updated last month
- An intuitive, easy-to-use python interface for batch resource requesting, access, job submission, and observation. Simplifying the develo…☆28Updated last week
- Cloud Native Benchmarking of Foundation Models☆36Updated 2 weeks ago
- Model Server for Kepler☆27Updated last week