Community maintained hardware plugin for vLLM on Spyre
☆53Sep 25, 2026Updated this week
Alternatives and similar repositories for sendnn-inference
Users that are interested in sendnn-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PyTorch backend for IBM's Spyre AIU☆58Updated this week
- Cloud Native Benchmarking of Foundation Models☆46Jul 31, 2025Updated last year
- FMS Model Optimizer is a framework for developing reduced precision neural network models.☆21Updated this week
- A tool to post-process json trace files for IBM-AIU performance analysis. It enhances the traces with additional statistics extracted fro…☆13Aug 31, 2026Updated 3 weeks ago
- IBM development fork of https://github.com/huggingface/text-generation-inference☆67Sep 18, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- High-performance Rust benchmark client for vLLM serving endpoints.☆52Aug 3, 2026Updated last month
- Python Ecosystem for Power Hints and Tips, Issue Tracking☆33Sep 17, 2026Updated last week
- Variant optimization autoscaler for distributed inference workloads☆57Updated this week
- Simplified model deployment on llm-d☆28Jul 2, 2025Updated last year
- Synthetic Data Generation for Foundation Models☆21Nov 10, 2025Updated 10 months ago
- ☆15Nov 15, 2018Updated 7 years ago
- Community maintained hardware plugin for vLLM on Intel Gaudi☆58Updated this week
- Tools and pipelines for automated LLM performance evaluation☆15May 20, 2026Updated 4 months ago
- SParse AcceleRation on Tensor Architecture☆18Apr 15, 2026Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆10Jun 26, 2026Updated 3 months ago
- Main rossoctl repo - installer, UI and docs☆301Updated this week
- A VPN plugin for NetworkManager using the proprietary Cisco AnyConnect VPN client☆16Dec 12, 2025Updated 9 months ago
- Estimate resources needed to train LLMs☆14Feb 10, 2026Updated 7 months ago
- llm-d benchmark scripts and tooling☆71Updated this week
- vLLM plugin for RBLN NPU☆59Updated this week
- Knative benchmark suite for Quarkus☆11Feb 5, 2026Updated 7 months ago
- ☆12Oct 7, 2025Updated 11 months ago
- Community maintained hardware plugin for vLLM on AWS Neuron☆51Aug 17, 2026Updated last month
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Message Broker for IoT/Mobile/Web. Mainly uses MQTT v3.x and v5. Aims to be easy to use, scalable and reliable☆53Sep 7, 2026Updated 2 weeks ago
- A simple app to help play and demo Cloud Native things☆28Nov 8, 2023Updated 2 years ago
- Additional tools for the Bee Agent Framework☆14Mar 18, 2025Updated last year
- A simple GPU reservation tool for single host shared development systems☆31Aug 24, 2026Updated last month
- Containerized version of HLS XMLTV - Create your own TV Channel's on your home network☆16Apr 7, 2020Updated 6 years ago
- Augmented Dickey-Fuller implementation in Go☆12Mar 15, 2019Updated 7 years ago
- qiskit-c-api-demo is a C++17/MPI implementation for HPC environments, enabling scalable hybrid quantum–classical workflows.☆38Jul 27, 2026Updated 2 months ago
- ☆26Nov 21, 2023Updated 2 years ago
- An external provider for Llama Stack allowing for the use of RamaLama for inference.☆22Dec 22, 2025Updated 9 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An SRIOV device plugin plugin☆15Aug 17, 2026Updated last month
- Template for crafting beautiful trainings with dynamic lab environments in an automated manner☆20Jan 28, 2021Updated 5 years ago
- template repo with recommended content for projects under the IBM org☆41Jul 2, 2026Updated 2 months ago
- helm charts for deploying models with llm-d☆32Updated this week
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆25Sep 1, 2026Updated 3 weeks ago
- Examples for building and running LLM services and applications locally with Podman☆208Feb 13, 2026Updated 7 months ago
- Nabla Containers blog☆12May 26, 2021Updated 5 years ago