Community maintained hardware plugin for vLLM on AWS Neuron
☆54Oct 20, 2026Updated this week
Alternatives and similar repositories for vllm-neuron
Users that are interested in vllm-neuron are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆73Updated this week
- ☆63Aug 19, 2026Updated 2 months ago
- AWS Neuron Deep Learning Containers (DLCs) are a set of Docker images for training and serving models on AWS Trainium and Inferentia inst…☆25Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆24Jun 9, 2026Updated 4 months ago
- ☆72Oct 16, 2026Updated last week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Show the time in Roman Numerals☆12Jan 23, 2020Updated 6 years ago
- ☆41Oct 13, 2026Updated last week
- a repo to study TensorRT Plugin☆11Apr 30, 2025Updated last year
- Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…☆647Updated this week
- Comprehensive Hugging Face Hub Library for rust☆24Sep 23, 2026Updated last month
- ☆54May 19, 2025Updated last year
- Breakable CUDA graph capture for PyTorch - capture compatible regions as CUDA graphs while running incompatible operations eagerly betwee…☆29Oct 8, 2026Updated 2 weeks ago
- ☆69Oct 16, 2026Updated last week
- Spot Tagging Bot for Digital Assets☆18Jul 19, 2021Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Collection of memory microbenchmarks to investigate NVIDIA GPUs Network on Chip architectures☆17Apr 14, 2026Updated 6 months ago
- Demo for Qwen2.5-VL-3B-Instruct on Axera device.☆16Sep 3, 2025Updated last year
- Terraform CherryServers provider☆13Updated this week
- ☆25Sep 8, 2026Updated last month
- A forked version of flux-fast that makes flux-fast even faster with cache-dit, 3.3x speedup on NVIDIA L20.☆24Jul 18, 2025Updated last year
- This repository contains code used for our Multi Sentence Inference NAACL'22 paper.☆12Mar 6, 2023Updated 3 years ago
- nnvm&tvm example of cross compilation and deployment in Nvidia Jetson TX2 platform☆11Apr 17, 2018Updated 8 years ago
- Fused MoE kernel☆23Aug 10, 2026Updated 2 months ago
- Lightweight Python Wrapper for OpenVINO, enabling LLM inference on NPUs☆30Dec 17, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- the symbol description of mobilenet v2☆11Sep 7, 2018Updated 8 years ago
- Evaluate Transformers from the Hub 🔥☆14Sep 24, 2026Updated 3 weeks ago
- Flash Attention v2 for Pascal (P100, GTX 1080) and Volta (V100) GPUs — bringing O(N) memory attention to hardware the official flash-attn…☆27Apr 4, 2026Updated 6 months ago
- NVFP4 Flash-Attention 4 on BlackWell☆69Sep 26, 2026Updated 3 weeks ago
- fake CUTLASS to get peformance☆26Apr 28, 2026Updated 5 months ago
- A safetensors extension to efficiently store sparse quantized tensors on disk☆333Updated this week
- Example code for AWS Neuron SDK developers building inference and training applications☆162Jul 15, 2026Updated 3 months ago
- JAX support for tvm-ffi abi☆28May 14, 2026Updated 5 months ago
- [CVPR 2025] The official implementation of "CacheQuant: Comprehensively Accelerated Diffusion Models"☆51Nov 2, 2025Updated 11 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Project showing how to develop NKI kernels for Llama 3.2 1B inference☆22May 29, 2025Updated last year
- A simple makefile for Scala projects☆11Dec 12, 2018Updated 7 years ago
- A minimal hackable implementation of policy gradient methods (GRPO, PPO, REINFORCE)☆18Feb 20, 2026Updated 8 months ago
- ☆23Jun 30, 2026Updated 3 months ago
- The (open-source part of) code to reproduce "BPPSA: Scaling Back-propagation by Parallel Scan Algorithm".☆13Jun 7, 2021Updated 5 years ago
- ♥️♠️♦️♣️️☆12Dec 22, 2020Updated 5 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆17Updated this week