A hardware-agnostic (NVIDIA's GPUs and AWS Inferentia accelerators) deployment of computer-vision models (e.g., YOLO, ViT), generate text and text-to-image (e.g., Llama3 and Stable Diffusion ) on EKS controlled by K8s ingress in routing-time and Karpenter in scheduling-time that is scaled by KEDA.
☆27Jul 1, 2025Updated last year
Alternatives and similar repositories for scalable-hw-agnostic-inference
Users that are interested in scalable-hw-agnostic-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Reproduce ABC-130K (abc.bot) on a desktop bimanual station — plus pi0 / pi0.5 and your own policies. Full stack from teleop collection to…☆12Sep 8, 2026Updated last month
- Implementation of the SPDM protocol☆16Updated this week
- ☆14Aug 3, 2026Updated 3 months ago
- A CLI tool to simulate EC2 Spot Instances interruptions using AWS Fault Injection Simulator.☆12May 4, 2022Updated 4 years ago
- ☆14Mar 25, 2026Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Kubernetes Autoscaling, published by Packt☆18Mar 26, 2026Updated 7 months ago
- ☆15Mar 27, 2019Updated 7 years ago
- ☆27Oct 27, 2026Updated last week
- EC2 Flexibility Score assesses any configuration used to launch instances through an Auto Scaling Group (ASG) against the recommended EC2…☆27Apr 13, 2026Updated 6 months ago
- Slemify demonstrates how to fine-tune and serve Small Language Models (1-8B parameters) on Kubernetes using CPUs. It takes a single YAML …☆31Updated this week
- Check if container images in a Kubernetes cluster have arm architecture support.☆28Mar 19, 2026Updated 7 months ago
- ☆26Apr 10, 2025Updated last year
- ☆39Oct 21, 2026Updated 2 weeks ago
- Implementation of Adepts Fuyu all-new Multi-Modality model in pytorch☆24Nov 11, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Terraform module to provision an EKS Fargate Profile☆45Oct 30, 2026Updated last week
- BPE Tokenizer implementations in C# for Anthropic, OpenAI LLM offerings☆14Oct 5, 2023Updated 3 years ago
- FFT PyTorch 0.3 GPU implementation & experiments with DeepFFT model in Video Action Recognition and VM Classification☆11Feb 21, 2019Updated 7 years ago
- streamline multi arch k8s runtimes☆57Oct 6, 2025Updated last year
- Spin Integration for .NET Aspire☆12Nov 4, 2025Updated last year
- Expanding the StateMachineUnity repo to work with a networking option.☆14Feb 16, 2023Updated 3 years ago
- Web app for creating animated illustrations with 3D JavaScript engine Zdog☆11Mar 17, 2022Updated 4 years ago
- 利用Travis CI、Github构建Python在线编译打包环境，自动生成windowsEXE二进制文件☆10Apr 24, 2023Updated 3 years ago
- Shading models for Unity’s Universal Render Pipeline.☆11Aug 25, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Simulation and analysis of cloud computing architectures and algorithms using CloudSim Plus☆12Sep 9, 2019Updated 7 years ago
- A Python toolkit for calculating the Access to Healthy Assets and Hazards (AHAH) index, measuring environmental factors that influence he…☆11Feb 4, 2026Updated 9 months ago
- Verilog code for a low power RFID chip that will communicate with I2C sensors.☆13Apr 18, 2014Updated 12 years ago
- Assembly-optimized Marvin32 hash function☆12Jan 17, 2024Updated 2 years ago
- Efficient Uncertainty Estimation for LiDAR-based 3D Object Detection☆10Nov 8, 2022Updated 3 years ago
- a suite of finetuned LLMs for atomically precise function calling 🧪☆16Oct 26, 2026Updated last week
- An encryption client that allows you to secure your sensitive data before you send it to Amazon S3.☆15Oct 21, 2026Updated 2 weeks ago
- OCR overlay for images and canvases☆10Jun 21, 2026Updated 4 months ago
- ☆13Oct 2, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Provides MongoDB access through .NET dependency injection, following Microsoft.Extensions.* library practices.☆12Updated this week
- A machine learning library focused on deep learning☆11Jun 2, 2015Updated 11 years ago
- Periodic screenshot capturer for recalling what you have worked.☆10Jun 27, 2024Updated 2 years ago
- RSS/Atom/RDF feed parser in .NET Standard 2.0☆12May 6, 2023Updated 3 years ago
- The .NET data provider for GaussDB.☆12Jun 22, 2026Updated 4 months ago
- Anomaly detection method for wireless sensor networks based on time series data☆11May 31, 2018Updated 8 years ago
- ☆10Jan 24, 2021Updated 5 years ago