rh-aiservices-bu / multi-gpu-llms
Repository to deploy LLMs with Multi-GPUs in distributed Kubernetes nodes
☆22Updated 4 months ago
Alternatives and similar repositories for multi-gpu-llms:
Users that are interested in multi-gpu-llms are comparing it to the libraries listed below
- AI-on-OpenShift website source code☆81Updated last week
- Resources, demos, recipes,... to work with LLMs on OpenShift with OpenShift AI or Open Data Hub.☆121Updated last week
- This project makes running the InstructLab large language model (LLM) fine-tuning process easy and flexible on OpenShift☆25Updated this week
- Source for the "Parasol Insurance" Lab☆66Updated last week
- Models as a Service☆53Updated 2 months ago
- AI Agents Workshop with Red Hat AI☆12Updated 2 months ago
- Artifacts for the Distributed Workloads stack as part of ODH☆30Updated this week
- ☆11Updated 2 weeks ago
- ☆23Updated 2 weeks ago
- Various custom Workbenches and Runtimes for Open Data Hub and OpenShift Data Science☆46Updated 10 months ago
- Collection of demos for building Llama Stack based apps on OpenShift☆22Updated this week
- An intuitive, easy-to-use python interface for batch resource requesting, access, job submission, and observation. Simplifying the develo…☆27Updated this week
- The AI Accelerator is a template project for setting up Red Hat OpenShift AI using GitOps☆52Updated this week
- Vanilla configurations for a RHOAI instance to deploy a GenAI POC. This will deploy a vector database (Milvus), a GenAI interface (Anythi…☆11Updated 2 weeks ago
- ☆16Updated last week
- ODH Tools & Extensions Companion☆20Updated 2 weeks ago
- Repository to demo GPU Sharing with Time Slicing, MPS, MIG and others☆39Updated 6 months ago
- A repository for Open Data Hub Kustomize manifests extending upstream Kubeflow manifests☆62Updated last year
- A lab/workshop for Red Hat OpenShift Data Science using simple fraud detection as an example workload☆21Updated 9 months ago
- ☆19Updated last week
- ☆13Updated 3 weeks ago
- Summarize Financial Data with a RAG workflow using Weaviate, Red Hat OpenShift and Red Hat Build of Apache Camel.☆20Updated 2 months ago
- Improve ROSA customer experience (and customer retention) by leveraging foundation models to do “gpt-chat” style search of Red Hat custo…☆27Updated last year
- ☆23Updated 2 weeks ago
- Design Considerations at the Edge of the ServiceMesh☆30Updated 11 months ago
- Materials for a workshop on OpenShift Service Mesh☆26Updated 3 years ago
- Open Data Hub operator to manage ODH component integrations☆77Updated this week
- Source for "Streamlining insurance claims with OpenShift AI" Lab☆39Updated 8 months ago
- Various demos of data pipelines☆31Updated 4 years ago
- InstaSlice Operator facilitates slicing of accelerators using stable APIs☆35Updated this week