rh-aiservices-bu / multi-gpu-llmsLinks
Repository to deploy LLMs with Multi-GPUs in distributed Kubernetes nodes
☆27Updated 10 months ago
Alternatives and similar repositories for multi-gpu-llms
Users that are interested in multi-gpu-llms are comparing it to the libraries listed below
Sorting:
- AI-on-OpenShift website source code☆93Updated 3 months ago
- Resources, demos, recipes,... to work with LLMs on OpenShift with OpenShift AI or Open Data Hub.☆137Updated last month
- Collection of demos for building Llama Stack based apps on OpenShift☆55Updated last month
- ☆27Updated 4 months ago
- The AI Accelerator is a template project for setting up Red Hat OpenShift AI using GitOps☆59Updated this week
- Source for the "Parasol Insurance" Lab☆87Updated last month
- rhods-disconnected-install-helper☆21Updated last week
- Source for "Streamlining insurance claims with OpenShift AI" Lab☆40Updated last year
- ☆16Updated this week
- ODH Tools & Extensions Companion☆23Updated 4 months ago
- ☆16Updated 3 months ago
- Models as a Service☆72Updated last week
- Various custom Workbenches and Runtimes for Open Data Hub and OpenShift Data Science☆48Updated last year
- An intuitive, easy-to-use python interface for batch resource requesting, access, job submission, and observation. Simplifying the develo…☆30Updated last week
- Artifacts for the Distributed Workloads stack as part of ODH☆33Updated this week
- Improve ROSA customer experience (and customer retention) by leveraging foundation models to do “gpt-chat” style search of Red Hat custo…☆27Updated last year
- Vanilla configurations for a RHOAI instance to deploy a GenAI POC. This will deploy a vector database (Milvus), a GenAI interface (Anythi…☆14Updated 6 months ago
- ☆24Updated 2 weeks ago
- ☆11Updated last week
- ☆28Updated this week
- ☆11Updated 3 years ago
- This repository contains the code developed for the talk "AI at the Edge with MicroShift" developed by Miguel Angel Ajo and Ricardo Norie…☆23Updated 2 years ago
- ☆16Updated last week
- ☆19Updated last week
- A lab/workshop for Red Hat OpenShift Data Science using simple fraud detection as an example workload☆21Updated last year
- Agentic AI framework examples with Red Hat AI☆16Updated 3 months ago
- MANUfacturing Edge Lightweight Accelerator☆38Updated 2 years ago
- ☆21Updated 4 years ago
- A repository for Open Data Hub Kustomize manifests extending upstream Kubeflow manifests☆62Updated last year
- Software Template for Openshift AI☆15Updated last week