Community maintained hardware plugin for vLLM on AWS Neuron
☆67Nov 13, 2026Updated this week
Alternatives and similar repositories for vllm-neuron
Users that are interested in vllm-neuron are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆78Oct 19, 2026Updated 3 weeks ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆24Jun 9, 2026Updated 5 months ago
- ☆42Oct 13, 2026Updated last month
- ☆72Oct 19, 2026Updated 3 weeks ago
- ☆13Dec 20, 2025Updated 10 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- The repo for integrating mini-sglang and AWS Neuron cores☆15Apr 9, 2026Updated 7 months ago
- AWS Neuron Deep Learning Containers (DLCs) are a set of Docker images for training and serving models on AWS Trainium and Inferentia inst…☆26Updated this week
- Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…☆654Updated this week
- ☆25Sep 8, 2026Updated 2 months ago
- ☆74Oct 26, 2026Updated 3 weeks ago
- A native PyTorch backend for AWS Trainium with support for eager execution, torch.compile, distributed training, and custom NKI kernels☆137Oct 30, 2026Updated 2 weeks ago
- Project showing how to develop NKI kernels for Llama 3.2 1B inference☆22May 29, 2025Updated last year
- Show the time in Roman Numerals☆12Jan 23, 2020Updated 6 years ago
- TPUMS (TPU Microbenchmark Suite) is a modular, high-fidelity benchmarking and profiling framework designed to evaluate the compute, memor…☆42Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆69Oct 16, 2026Updated last month
- ☆19Apr 24, 2022Updated 4 years ago
- Training and inference on AWS Trainium and Inferentia chips.☆271Updated this week
- ☆23May 5, 2025Updated last year
- Build State-of-the-art NLP Models with Amazon SageMaker and GluonNLP☆10Dec 4, 2019Updated 6 years ago
- Example code for AWS Neuron SDK developers building inference and training applications☆163Nov 9, 2026Updated last week
- a repo to study TensorRT Plugin☆11Apr 30, 2025Updated last year
- ☆18Updated this week
- ☆54May 19, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- DeepEP: an efficient expert-parallel communication library☆16Nov 12, 2026Updated last week
- Notebooks and sample code for Build On Trainium☆48Jan 14, 2026Updated 10 months ago
- Spot Tagging Bot for Digital Assets☆18Jul 19, 2021Updated 5 years ago
- CP-Bench is a PyTorch testing/benchmarking suite to detect AI hardware issues, such as functional reliability, silent data corruption, an…☆19Jun 5, 2026Updated 5 months ago
- End-to-end tests for Finch☆16Aug 7, 2026Updated 3 months ago
- A safetensors extension to efficiently store sparse quantized tensors on disk☆338Updated this week
- ☆13Dec 19, 2025Updated 11 months ago
- LLM inference in C/C++☆17Updated this week
- Common GitHub workflows, actions, and shared tooling used across the Strands Agents organization.☆18Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.☆11Sep 16, 2025Updated last year
- ☆10Jul 18, 2026Updated 4 months ago
- [FCCM 2023] PASTA: Programming and Automation Support for Scalable Task-Parallel HLS Programs on Modern Multi-Die FPGAs☆14Jun 26, 2025Updated last year
- Demo for Qwen2.5-VL-3B-Instruct on Axera device.☆16Sep 3, 2025Updated last year
- ☆16Oct 5, 2026Updated last month
- An evolving, end-to-end reference for collecting and augmenting data, training, evaluating, and deploying embodied AI systems. Accelerate…☆15Sep 11, 2026Updated 2 months ago
- ACK service controller for Amazon SageMaker☆53Nov 10, 2026Updated last week
Are these results useful?