rh-aiservices-bu / multi-gpu-llms
Repository to deploy LLMs with Multi-GPUs in distributed Kubernetes nodes
☆21Updated last month
Alternatives and similar repositories for multi-gpu-llms:
Users that are interested in multi-gpu-llms are comparing it to the libraries listed below
- AI-on-OpenShift website source code☆75Updated last week
- Resources, demos, recipes,... to work with LLMs on OpenShift with OpenShift AI or Open Data Hub.☆104Updated this week
- The AI Accelerator is a template project for setting up Red Hat OpenShift AI using GitOps☆35Updated 3 weeks ago
- Models as a Service☆28Updated this week
- An intuitive, easy-to-use python interface for batch resource requesting, access, job submission, and observation. Simplifying the develo…☆22Updated last week
- ODH Tools & Extensions Companion☆17Updated this week
- ☆22Updated this week
- ☆22Updated 3 months ago
- Source for the "Parasol Insurance" Lab☆52Updated this week
- Source for "Streamlining insurance claims with OpenShift AI" Lab☆38Updated 4 months ago
- ☆11Updated 3 months ago
- Artifacts for the Distributed Workloads stack as part of ODH☆24Updated this week
- ☆18Updated last month
- Repository to demo GPU Sharing with Time Slicing, MPS, MIG and others☆30Updated 3 months ago
- This is material for a tutorial that @sophwats and @willb developed about machine learning workflows and about running them on OpenShift☆39Updated 2 years ago
- This repository contains the code developed for the talk "AI at the Edge with MicroShift" developed by Miguel Angel Ajo and Ricardo Norie…☆20Updated last year
- A lab/workshop for Red Hat OpenShift Data Science using simple fraud detection as an example workload☆21Updated 6 months ago
- This project makes running the InstructLab large language model (LLM) fine-tuning process easy and flexible on OpenShift☆14Updated this week
- Design Considerations at the Edge of the ServiceMesh☆30Updated 7 months ago
- Exercise materials for AI262, AI263, AI264, AI265, AI266, and AI267☆23Updated last week
- Day in the Streaming Life (Event-Driven) Workshop☆48Updated last year
- Materials for a workshop on OpenShift Service Mesh☆26Updated 2 years ago
- ☆23Updated 5 months ago
- Various custom Workbenches and Runtimes for Open Data Hub and OpenShift Data Science☆41Updated 6 months ago
- ☆27Updated this week
- Various demos of data pipelines☆31Updated 3 years ago
- rhods-disconnected-install-helper☆13Updated this week
- Open Data Hub operator to manage ODH component integrations☆64Updated this week
- Improve ROSA customer experience (and customer retention) by leveraging foundation models to do “gpt-chat” style search of Red Hat custo…☆27Updated 9 months ago
- ☆19Updated this week