aws-samples / scalable-hw-agnostic-inferenceView external linksLinks
A hardware-agnostic (NVIDIA's GPUs and AWS Inferentia accelerators) deployment of computer-vision models (e.g., YOLO, ViT), generate text and text-to-image (e.g., Llama3 and Stable Diffusion ) on EKS controlled by K8s ingress in routing-time and Karpenter in scheduling-time that is scaled by KEDA.
☆27Jul 1, 2025Updated 7 months ago
Alternatives and similar repositories for scalable-hw-agnostic-inference
Users that are interested in scalable-hw-agnostic-inference are comparing it to the libraries listed below
Sorting:
- Physical Downlink Shared Channel (PDSCH) in 5G New Radio.☆12Jan 29, 2024Updated 2 years ago
- Verilog code for a low power RFID chip that will communicate with I2C sensors.☆13Apr 18, 2014Updated 11 years ago
- 基于GSConv+SlimNeck的YOLOv5的消防通道占用检测系统☆10Nov 24, 2023Updated 2 years ago
- ☆11Oct 19, 2023Updated 2 years ago
- BPE Tokenizer implementations in C# for Anthropic, OpenAI LLM offerings☆14Oct 5, 2023Updated 2 years ago
- ☆11Nov 26, 2024Updated last year
- A Federated Learning Method for Real-time Emotion State Classification from Multi-modal Streaming☆11Sep 15, 2022Updated 3 years ago
- This project demonstrates how Low Density Parity Check (LDPC) Code and Multiple Input Multiple Output (MIMO) can be employed in Vehicular…☆14Jan 24, 2022Updated 4 years ago
- Master Thesis☆10Jan 28, 2023Updated 3 years ago
- A Beginner's Python Guide for Data Analysis☆22Nov 5, 2019Updated 6 years ago
- Go Board FPGA Project for Ambient Light Sensor in VHDL and Verilog☆10Apr 20, 2019Updated 6 years ago
- Elevate the CPU Priority of the game process. Improve overall performance and Prevent stutters caused by other processes.☆11Mar 24, 2025Updated 10 months ago
- wifi☆12Jun 13, 2017Updated 8 years ago
- Thesis in Federated Learning using an Edge/Cloud Computing architecture☆10Feb 26, 2021Updated 4 years ago
- ☆12Apr 5, 2019Updated 6 years ago
- A Python CLI application that demonstrates how you can access AWS services, such as Amazon S3 and Amazon Athena, using trusted identity p…☆12Mar 11, 2025Updated 11 months ago
- Duck Game mod☆11Jun 11, 2024Updated last year
- I have developed a custom environment using OpenAI Gym in Python for simulating a 5G wireless communication channel as part of a reinforc…☆13Mar 27, 2024Updated last year
- AI-based Resource Provisioning of IoE Services in 6G: A Deep Reinforcement Learning Approach☆12Mar 31, 2021Updated 4 years ago
- Source code for ComNet paper: Satellite multi-beam multicast support for an efficient community-based CDN☆10Jul 26, 2022Updated 3 years ago
- Prototype of Python / GeoGebra interoperability☆16Feb 7, 2026Updated last week
- Universal tool for managing your computer. Monitoring of temperatures and power consumption, checking the health status of hard drives an…☆10Feb 13, 2022Updated 4 years ago
- Code for our paper "Performance Study on a CSMA/CA-Based MAC Protocol for Multi-User MIMO Wireless LANs"☆12Aug 31, 2019Updated 6 years ago
- Dense Wireless Connectivity Datasets for the IoT.☆11Aug 13, 2019Updated 6 years ago
- 使用Cordic算法函数运算，在资源受限的设备上运行（如资源较少的FPGA、嵌入式MCU），避免了浮点运算、乘法、除法，只用移位和加法函数的计算。☆11Mar 22, 2024Updated last year
- The .NET data provider for GaussDB.☆10Nov 19, 2025Updated 2 months ago
- Learning Environment-aware and hardware-compatible beam-forming codebooks☆15Mar 8, 2020Updated 5 years ago
- Simulation and analysis of cloud computing architectures and algorithms using CloudSim Plus☆12Sep 9, 2019Updated 6 years ago
- openwrt management tool☆12Dec 6, 2018Updated 7 years ago
- Unity-chan's Ball a Roll demo project☆12Apr 6, 2017Updated 8 years ago
- Docker containers that run DPDK on ubuntu, rockylinux and rhel etc host machines.☆13Jul 10, 2025Updated 7 months ago
- Native lakehouse experience in Postgres powered by DuckDB & Ducklake☆45Updated this week
- Dedicated Minetest Game Server hosting on Kubernetes using Agones☆10Nov 18, 2025Updated 2 months ago
- An asynchronous-based finite state machine for Unity.☆14Jul 20, 2023Updated 2 years ago
- Multi-Objective Reinforcement Learning sandbox☆12Dec 20, 2021Updated 4 years ago
- Real-time OLTP system for credit card fraud detection using AWS API Gateway, Kinesis, and RDS PostgreSQL. Features a scalable, serverless…☆22Dec 16, 2024Updated last year
- Public repository of the data, scripts and methodology presented in the paper "Towards On-Board SAR Processing with FPGA Accelerators and…☆12Apr 12, 2023Updated 2 years ago
- ADO.NET Provider for Presto/Trino☆13Oct 3, 2022Updated 3 years ago
- ☆10Nov 10, 2019Updated 6 years ago