eliran89c / self-hosted-llm-on-eks
Deploy and manage a self-hosted LLM using EKS.
☆16Updated 2 months ago
Alternatives and similar repositories for self-hosted-llm-on-eks:
Users that are interested in self-hosted-llm-on-eks are comparing it to the libraries listed below
- Amazon ECS Auto Scaling for GPU-based Machine Learning Workloads☆16Updated last year
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆44Updated 9 months ago
- ☆25Updated last month
- ☆55Updated 2 months ago
- ☆62Updated last month
- ☆52Updated last week
- ☆64Updated last year
- ☆11Updated 5 months ago
- ☆91Updated 7 months ago
- ☆13Updated 3 weeks ago
- The repo contains the code samples for "ECS Anywhere workshop". The intent of this workshop is to educate users about the ECS-Anywhere an…☆21Updated 3 years ago
- ☆26Updated last year
- This is the reference implementation of CNOE and its toolings on AWS☆66Updated last month
- ☆18Updated last week
- Smart Kubernetes Scheduling☆78Updated 2 weeks ago
- Terraform module for GitOps bridge☆26Updated last year
- A prototype of an AI-based system administrator☆49Updated last year
- ☆35Updated 3 years ago
- Terraform Module: Deploy Data/ML Addons Helm Charts on EKS 🚀☆41Updated last week
- Script to collect Pod related information from EKS Cluster☆14Updated last month
- Source repo of Building SaaS applications on Amazon EKS using GitOps workshop☆72Updated 4 months ago
- This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It …☆42Updated 2 months ago
- ☆36Updated 8 months ago
- ☆28Updated last year
- ☆18Updated last week
- Access k8s pod ip, service ip☆43Updated last year
- The project implements an Amazon EKS Cross-AZ Pod to Pod network bytes visability It is based on this blog: https://aws.amazon.com/blogs/…☆32Updated 6 months ago
- Step by step tutorial for those who have zero knowledge to Amazon EKS.☆14Updated 2 weeks ago
- End to end deployment and observability of polyglot microservices in Amazon EKS using AWS App Mesh, AWS Fargate, Amazon Cloudwatch Contai…☆72Updated 2 months ago
- ☆45Updated 2 months ago