openshift-psap / llm-load-test
☆37Updated 2 weeks ago
Alternatives and similar repositories for llm-load-test:
Users that are interested in llm-load-test are comparing it to the libraries listed below
- Repository to demo GPU Sharing with Time Slicing, MPS, MIG and others☆35Updated 5 months ago
- This project makes running the InstructLab large language model (LLM) fine-tuning process easy and flexible on OpenShift☆21Updated last week
- ☆19Updated last week
- Improve ROSA customer experience (and customer retention) by leveraging foundation models to do “gpt-chat” style search of Red Hat custo…☆27Updated last year
- ☆16Updated last week
- AI-on-OpenShift website source code☆79Updated 2 weeks ago
- Artifacts for the Distributed Workloads stack as part of ODH☆26Updated this week
- ☆110Updated this week
- Resources, demos, recipes,... to work with LLMs on OpenShift with OpenShift AI or Open Data Hub.☆115Updated last week
- Models as a Service☆47Updated 3 weeks ago
- Test Orchestrator for Performance and Scalability of AI pLatforms☆13Updated this week
- Repository to deploy LLMs with Multi-GPUs in distributed Kubernetes nodes☆22Updated 3 months ago
- InstaSlice Operator facilitates slicing of accelerators using stable APIs☆30Updated this week
- Examples for building and running LLM services and applications locally with Podman☆142Updated 2 weeks ago
- Containerization and cloud native suite for OPEA☆45Updated this week
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆92Updated this week
- ☆23Updated 5 months ago
- Open Data Hub operator to manage ODH component integrations☆75Updated this week
- An intuitive, easy-to-use python interface for batch resource requesting, access, job submission, and observation. Simplifying the develo…☆23Updated this week
- Source for the "Parasol Insurance" Lab☆65Updated 2 months ago
- The AI Accelerator is a template project for setting up Red Hat OpenShift AI using GitOps☆48Updated this week
- Controller for ModelMesh☆226Updated last week
- Caikit is an AI toolkit that enables users to manage models through a set of developer friendly APIs.☆104Updated 6 months ago
- ODH Tools & Extensions Companion☆19Updated 2 months ago
- 🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.☆38Updated this week
- Source for "Streamlining insurance claims with OpenShift AI" Lab☆39Updated 7 months ago
- Core repository for an AI-powered OCP assistant service☆43Updated this week
- Taxonomy tree that will allow you to create models tuned with your data☆247Updated last week
- Cloud Native Benchmarking of Foundation Models☆24Updated 4 months ago
- AI Agents Workshop with Red Hat AI☆12Updated last month