☆40Jul 28, 2026Updated last month
Alternatives and similar repositories for neuronx-distributed-inference
Users that are interested in neuronx-distributed-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆72Aug 26, 2026Updated 3 weeks ago
- Notebooks and sample code for Build On Trainium☆48Jan 14, 2026Updated 8 months ago
- ☆68Apr 9, 2026Updated 5 months ago
- ☆13Dec 19, 2025Updated 9 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆24Jun 9, 2026Updated 3 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Example code for AWS Neuron SDK developers building inference and training applications☆162Jul 15, 2026Updated 2 months ago
- Research orchestration platform where human researchers and AI agents collaborate☆35Jul 21, 2026Updated last month
- ☆18May 9, 2024Updated 2 years ago
- This repository features Amazon SageMaker Ground Truth and explains how to ingest raw 3D point cloud data, label it, train a 3D object de…☆13Jun 23, 2022Updated 4 years ago
- ☆43Jan 29, 2026Updated 7 months ago
- ☆24Nov 18, 2025Updated 10 months ago
- Community maintained hardware plugin for vLLM on AWS Neuron☆51Aug 17, 2026Updated last month
- NKIPy: Rapid Prototyping on Trainium☆30Updated this week
- This open-source project delivers a complete pipeline for converting multi-page documents (PDFs/images) into structured JSON using Vision…☆16Apr 9, 2026Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Training and inference on AWS Trainium and Inferentia chips.☆269Updated this week
- ☆11Mar 28, 2024Updated 2 years ago
- ☆13Jun 20, 2023Updated 3 years ago
- ☆25Sep 8, 2026Updated last week
- ☆14May 29, 2024Updated 2 years ago
- Local reverse proxy between Claude Code CLI and AWS Bedrock — fixes prompt caching TTL, Agent SDK missing cache, thinking/effort optimiza…☆15May 3, 2026Updated 4 months ago
- CDK Construct that generates an API to get an S3 pre-signed url for file uploads☆24May 26, 2023Updated 3 years ago
- The repository guides you through generating a synthetic dataset for a QA-RAG application using the Bedrock API, Python and Langchain.☆21Sep 17, 2024Updated 2 years ago
- Autocomp: Optimize any AI kernel, anywhere.☆148Jul 11, 2026Updated 2 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Implementation of Image Classification using Visual Transformers in Amazon SageMaker based on the ideas from research paper - Visual Tran…☆18Dec 28, 2020Updated 5 years ago
- A lightweight Map for {N}☆13Aug 12, 2026Updated last month
- ☆25Oct 30, 2024Updated last year
- ☆117May 29, 2026Updated 3 months ago
- An AWS Lambda function that converts any document format that LibreOffice can import to any document format that LibreOffice can export☆25Oct 12, 2023Updated 2 years ago
- Hands-on workshop for distributed training and hosting on SageMaker☆152Jun 16, 2026Updated 3 months ago
- Python for multiobjective cash management☆13Sep 21, 2017Updated 8 years ago
- Fine-tune FLUX 1.dev for personal AI photos☆22Sep 4, 2024Updated 2 years ago
- Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…☆633Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆26Nov 18, 2025Updated 10 months ago
- ☆23Mar 1, 2026Updated 6 months ago
- ☆14Dec 20, 2023Updated 2 years ago
- Amazon Bedrock AI Karaoke is an interactive demonstration of Amazon Bedrock. Users complete the prompt with the microphone and choose the…☆20Jan 29, 2025Updated last year
- ☆71Apr 8, 2026Updated 5 months ago
- ☆11Oct 29, 2024Updated last year
- ☆27Mar 22, 2022Updated 4 years ago