Community maintained hardware plugin for vLLM on AWS Neuron
☆46Jul 21, 2026Updated this week
Alternatives and similar repositories for vllm-neuron
Users that are interested in vllm-neuron are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆68Jul 14, 2026Updated last week
- AWS Neuron Deep Learning Containers (DLCs) are a set of Docker images for training and serving models on AWS Trainium and Inferentia inst…☆23Updated this week
- ☆71Jun 22, 2026Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMs☆26Jun 9, 2026Updated last month
- ☆39Jul 9, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆52May 19, 2025Updated last year
- SGLang kernel library for Intel XPU☆27Updated this week
- ☆11Feb 19, 2021Updated 5 years ago
- Jupyter notebooks for a tutorial/computational part of mini-series on "Foundations of Theoretical and Computational Open Quantum Systems"…☆17Feb 26, 2021Updated 5 years ago
- Collection of memory microbenchmarks to investigate NVIDIA GPUs Network on Chip architectures☆15Apr 14, 2026Updated 3 months ago
- Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…☆619Updated this week
- Lightweight Python Wrapper for OpenVINO, enabling LLM inference on NPUs☆29Dec 17, 2024Updated last year
- This demo shows how you can use Amazon IVS's Auto-Record-to-S3 feature in conjunction with Amazon Rekognition to moderate streams.☆10May 1, 2023Updated 3 years ago
- Community maintained hardware plugin for vLLM on Spyre☆52Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆24Nov 18, 2025Updated 8 months ago
- A forked version of flux-fast that makes flux-fast even faster with cache-dit, 3.3x speedup on NVIDIA L20.☆24Jul 18, 2025Updated last year
- nnvm&tvm example of cross compilation and deployment in Nvidia Jetson TX2 platform☆11Apr 17, 2018Updated 8 years ago
- Demo for Qwen2.5-VL-3B-Instruct on Axera device.☆16Sep 3, 2025Updated 10 months ago
- the symbol description of mobilenet v2☆11Sep 7, 2018Updated 7 years ago
- NKIPy: Rapid Prototyping on Trainium☆29Updated this week
- ☆16Aug 5, 2025Updated 11 months ago
- A safetensors extension to efficiently store sparse quantized tensors on disk☆306Updated this week
- ☆69Dec 29, 2025Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆22May 5, 2025Updated last year
- [CVPR 2025] The official implementation of "CacheQuant: Comprehensively Accelerated Diffusion Models"☆48Nov 2, 2025Updated 8 months ago
- fake CUTLASS to get peformance☆26Apr 28, 2026Updated 2 months ago
- ☆12Dec 14, 2024Updated last year
- The (open-source part of) code to reproduce "BPPSA: Scaling Back-propagation by Parallel Scan Algorithm".☆13Jun 7, 2021Updated 5 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆18Updated this week
- JAX support for tvm-ffi abi☆26May 14, 2026Updated 2 months ago
- ☆12Aug 12, 2022Updated 3 years ago
- Perf monitoring CLI tool for Apple Silicon☆10Jan 25, 2023Updated 3 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆13Jul 10, 2026Updated 2 weeks ago
- Nebula: Deep Neural Network Benchmarks in C++☆13Jan 2, 2025Updated last year
- Community maintained hardware plugin for vLLM on Intel Gaudi☆49Updated this week
- A branch of marss with DRAMSim hooks☆19Aug 22, 2013Updated 12 years ago
- ☆23Jun 30, 2026Updated 3 weeks ago
- High-performance LLM operator library built on TileLang.☆163Updated this week
- ☆21Nov 6, 2025Updated 8 months ago