Deploy and manage a self-hosted LLM using EKS.
☆17Jan 29, 2025Updated last year
Alternatives and similar repositories for self-hosted-llm-on-eks
Users that are interested in self-hosted-llm-on-eks are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆35Apr 10, 2025Updated last year
- ☆14May 19, 2023Updated 3 years ago
- ☆52May 1, 2025Updated last year
- Python for multiobjective cash management☆13Sep 21, 2017Updated 9 years ago
- Run Haystack Pipelines on Ray☆20Oct 16, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆15Dec 15, 2025Updated 9 months ago
- ☆11Oct 29, 2024Updated last year
- A simple Streamlit application to visualize document chunks and queries in embedding space 🗺️🔍☆14Apr 15, 2025Updated last year
- Amazon ECS Auto Scaling for GPU-based Machine Learning Workloads☆19Jan 29, 2024Updated 2 years ago
- Run FMBench simultaneously across multiple Amazon EC2 machines to benchmark an FM across multiple serving stacks simultaneously☆15Apr 11, 2025Updated last year
- ☆13Nov 14, 2024Updated last year
- This project demonstrates the use of terraform to provision and deploy a three-tier application architecture to AWS☆29Feb 27, 2024Updated 2 years ago
- ☆17Jun 10, 2024Updated 2 years ago
- Cloud Agnostic IaC based SaaS Skeleton☆11Jun 24, 2026Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference…☆19Sep 4, 2026Updated 3 weeks ago
- Boilerplate example of managing OPA with kustomize☆18Jul 21, 2026Updated 2 months ago
- Overview of philips-labs helm charts☆16Sep 8, 2026Updated 2 weeks ago
- SaladCloud Virtual Kubelet provider☆17Dec 8, 2025Updated 9 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆24Jun 9, 2026Updated 3 months ago
- Sireus - SRE Utility System - Decision System for tracking SRE and DevOps operational state and executing commands☆14Feb 24, 2023Updated 3 years ago
- Kubernetes-Native Resource Operations☆148Updated this week
- ☆27Mar 15, 2024Updated 2 years ago
- AutoQASM is an experimental module offering a quantum-imperative programming experience in Python for developing quantum programs.☆22Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆49Jun 26, 2026Updated 3 months ago
- ☆13Dec 23, 2020Updated 5 years ago
- This open-source project delivers a complete pipeline for converting multi-page documents (PDFs/images) into structured JSON using Vision…☆16Apr 9, 2026Updated 5 months ago
- Blue/Green deployment with AWS Developer tools on Amazon EC2 using Amazon EFS to host application source code☆11Jul 27, 2021Updated 5 years ago
- ☆33Jul 2, 2026Updated 2 months ago
- Definition of Cluster Stacks based on the ClusterAPI ClusterClass feature☆13Updated this week
- ☆15Jun 12, 2022Updated 4 years ago
- Comprehensive benchmarks and evaluations of Large Language Models (LLMs) with a focus on hardware usage, generation speed, and memory req…☆12Aug 31, 2023Updated 3 years ago
- ☆10Oct 29, 2024Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆20Sep 1, 2026Updated 3 weeks ago
- Sample code snippets for consuming the CloudSploit API☆13Nov 10, 2023Updated 2 years ago
- Repository for KCNA exam prep and book☆16Apr 3, 2022Updated 4 years ago
- A CLI tool to generate shadcn registry files.☆15Nov 24, 2024Updated last year
- Replace placeholders with this ArgoCD plugin stored in sops encrypted file☆12Jun 15, 2026Updated 3 months ago
- ☆28Nov 15, 2022Updated 3 years ago
- [한국어/English]This workshop is designed to educate engineers that might not be familiar with Amazon ECS, Fargate, and possibly even Docker…☆27Jan 16, 2021Updated 5 years ago