☆39Jul 28, 2026Updated last week
Alternatives and similar repositories for neuronx-distributed-inference
Users that are interested in neuronx-distributed-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Notebooks and sample code for Build On Trainium☆48Jan 14, 2026Updated 6 months ago
- ☆68Apr 9, 2026Updated 4 months ago
- MLSys competition for the best MOE NKI kernels☆48May 29, 2026Updated 2 months ago
- Project showing how to develop NKI kernels for Llama 3.2 1B inference☆21May 29, 2025Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆26Jun 9, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A Python-based tool, trained on the state-of-the-art Google Pegasus model, specializing in generating abstracts from given YouTube video …☆10Aug 6, 2023Updated 3 years ago
- Example code for AWS Neuron SDK developers building inference and training applications☆162Jul 15, 2026Updated 3 weeks ago
- Research orchestration platform where human researchers and AI agents collaborate☆29Jul 21, 2026Updated 2 weeks ago
- ☆18May 9, 2024Updated 2 years ago
- This repository features Amazon SageMaker Ground Truth and explains how to ingest raw 3D point cloud data, label it, train a 3D object de…☆13Jun 23, 2022Updated 4 years ago
- ☆43Jan 29, 2026Updated 6 months ago
- ☆24Nov 18, 2025Updated 8 months ago
- Community maintained hardware plugin for vLLM on AWS Neuron☆47Jul 21, 2026Updated 2 weeks ago
- This open-source project delivers a complete pipeline for converting multi-page documents (PDFs/images) into structured JSON using Vision…☆16Apr 9, 2026Updated 4 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- NKIPy: Rapid Prototyping on Trainium☆29Updated this week
- Training and inference on AWS Trainium and Inferentia chips.☆267Updated this week
- AWS Neuron Deep Learning Containers (DLCs) are a set of Docker images for training and serving models on AWS Trainium and Inferentia inst…☆23Jul 30, 2026Updated last week
- ☆25Jul 23, 2026Updated 2 weeks ago
- Use the two different methods (deepspeed and SageMaker model parallelism library) to fine tune llama model on Sagemaker. Then deploy the …☆24Aug 1, 2023Updated 3 years ago
- ☆34Aug 3, 2026Updated last week
- Use Cloudfront to build a proxy for Bedrock to accelerate access from globally☆16Nov 26, 2024Updated last year
- Autocomp: Optimize any AI kernel, anywhere.☆146Jul 11, 2026Updated 3 weeks ago
- ☆15Apr 13, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆109May 29, 2026Updated 2 months ago
- An AWS Lambda function that converts any document format that LibreOffice can import to any document format that LibreOffice can export☆25Oct 12, 2023Updated 2 years ago
- Hands-on workshop for distributed training and hosting on SageMaker☆153Jun 16, 2026Updated last month
- ☆15Mar 6, 2024Updated 2 years ago
- ☆17Apr 13, 2026Updated 3 months ago
- ☆25Nov 18, 2025Updated 8 months ago
- [NeurIPS 2024] | An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding☆22Oct 10, 2024Updated last year
- ☆23Mar 1, 2026Updated 5 months ago
- ☆14Dec 20, 2023Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆27Jan 22, 2026Updated 6 months ago
- ☆25Jul 17, 2026Updated 3 weeks ago
- ☆71Apr 8, 2026Updated 4 months ago
- ☆11Oct 29, 2024Updated last year
- ☆27Mar 22, 2022Updated 4 years ago
- A simple Streamlit application to visualize document chunks and queries in embedding space 🗺️🔍☆14Apr 15, 2025Updated last year
- ☆30Feb 25, 2025Updated last year