Community maintained hardware plugin for vLLM on Spyre
☆53Aug 31, 2026Updated last week
Alternatives and similar repositories for sendnn-inference
Users that are interested in sendnn-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Cloud Native Benchmarking of Foundation Models☆46Jul 31, 2025Updated last year
- A tool to post-process json trace files for IBM-AIU performance analysis. It enhances the traces with additional statistics extracted fro…☆13Aug 31, 2026Updated last week
- IBM development fork of https://github.com/huggingface/text-generation-inference☆67Sep 18, 2025Updated 11 months ago
- High-performance Rust benchmark client for vLLM serving endpoints.☆52Aug 3, 2026Updated last month
- Python Ecosystem for Power Hints and Tips, Issue Tracking☆33Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Variant optimization autoscaler for distributed inference workloads☆57Updated this week
- Simplified model deployment on llm-d☆28Jul 2, 2025Updated last year
- Synthetic Data Generation for Foundation Models☆21Nov 10, 2025Updated 9 months ago
- Community maintained hardware plugin for vLLM on Intel Gaudi☆53Updated this week
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆14Jan 30, 2026Updated 7 months ago
- Tools and pipelines for automated LLM performance evaluation☆15May 20, 2026Updated 3 months ago
- SParse AcceleRation on Tensor Architecture☆18Apr 15, 2026Updated 4 months ago
- Main rossoctl repo - installer, UI and docs☆299Updated this week
- vLLM plugin for RBLN NPU☆58Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Estimate resources needed to train LLMs☆14Feb 10, 2026Updated 6 months ago
- llm-d benchmark scripts and tooling☆67Updated this week
- Community maintained hardware plugin for vLLM on AWS Neuron☆51Aug 17, 2026Updated 3 weeks ago
- This repository provides the Open-CE environment files and version definitions for each Open-CE release.☆97May 8, 2026Updated 3 months ago
- A simple app to help play and demo Cloud Native things☆28Nov 8, 2023Updated 2 years ago
- Message Broker for IoT/Mobile/Web. Mainly uses MQTT v3.x and v5. Aims to be easy to use, scalable and reliable☆53Updated this week
- ☆52Mar 17, 2025Updated last year
- A simple GPU reservation tool for single host shared development systems☆30Aug 24, 2026Updated 2 weeks ago
- qiskit-c-api-demo is a C++17/MPI implementation for HPC environments, enabling scalable hybrid quantum–classical workflows.☆38Jul 27, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [DEPRECATED] Prometheus exporter for VPA recommendations☆12Aug 22, 2023Updated 3 years ago
- ☆26Nov 21, 2023Updated 2 years ago
- An external provider for Llama Stack allowing for the use of RamaLama for inference.☆22Dec 22, 2025Updated 8 months ago
- An SRIOV device plugin plugin☆15Aug 17, 2026Updated 3 weeks ago
- helm charts for deploying models with llm-d☆32Updated this week
- Examples for building and running LLM services and applications locally with Podman☆206Feb 13, 2026Updated 6 months ago
- Tool to detect and report leaked MPI objects like MPI_Requests and MPI_Datatypes☆13Sep 17, 2014Updated 11 years ago
- Nabla Containers blog☆12May 26, 2021Updated 5 years ago
- ibm-cos-sdk-python☆46Apr 14, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Portable TLauncher Minecraft Launcher☆14Dec 29, 2023Updated 2 years ago
- Systematic and comprehensive benchmarks for LLM systems.☆61Jan 28, 2026Updated 7 months ago
- Online Spatial Concept and Lexical Acquisition with Simultaneous Localization and Mapping☆10Sep 11, 2020Updated 5 years ago
- A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM☆812Updated this week
- The AI Agents behind the IBM Granite Playground☆17Jul 15, 2026Updated last month
- RAKF for MVS 3.8j☆14Aug 13, 2026Updated 3 weeks ago
- CLI for the Serverless Supercomputer☆25Sep 17, 2025Updated 11 months ago