Asynchronous Processor for Inference Gateway. Orchestrator of queues
☆15Nov 6, 2026Updated this week
Alternatives and similar repositories for llm-d-async
Users that are interested in llm-d-async are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- llm-d-batch-gateway is a standalone, backend-agnostic, OpenAI-compatible batch API and processing engine☆28Updated this week
- Performance analysis for distributed inference systems☆15Updated this week
- Variant optimization autoscaler for distributed inference workloads☆61Updated this week
- ☆29Apr 25, 2022Updated 4 years ago
- A repository containing a collection of "glue" modules for encapsulating common Cloud Run patterns.☆29Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆22Jul 24, 2021Updated 5 years ago
- Model Express is a Rust-based component meant to be placed next to existing model inference systems to speed up their startup times and i…☆202Updated this week
- Rust cloud object storage tools☆12Aug 9, 2021Updated 5 years ago
- Dockerized CLI tool that retrieves a GitHub App installation access token, given the App's ID and private key☆11Oct 29, 2026Updated last week
- AppWrapper controller for Kueue☆18Oct 30, 2026Updated last week
- Fivetran SDK for Go☆12Updated this week
- "GitOps" repo for Cloud Native Nordics k8s environment☆13Nov 27, 2021Updated 4 years ago
- ☆28Updated this week
- The Rusty WIndow Manager☆10May 2, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- NTP‑synced nixie clock in std Rust☆12Apr 5, 2026Updated 7 months ago
- fork mirror of shipcat up until july'21 since babylonhealth closed it soon after☆12May 6, 2022Updated 4 years ago
- NVIDIA Fleet Intelligence Agent - Host agent for GPU telemetry collection and attestation☆58Updated this week
- The k8s-generic-webhook is a library to simplify the implementation of webhooks for arbitrary customer resources (CR) in the operator-sdk…☆15Updated this week
- Proxy to allow multi tenant sharing of Git credentials.☆12Nov 24, 2025Updated 11 months ago
- Pure-Go wrapper for Pydantic Monty Python interpreter via WASM + wazero☆64Sep 19, 2026Updated last month
- A simple wrapper for SQL connections using SQLAlchemy and Pandas read_sql to standardize SQL workflow with multiple data sources.☆11Jan 7, 2022Updated 4 years ago
- Twitch API library written in Rust☆13Feb 3, 2022Updated 4 years ago
- APM for teams that already run the LGTM stack☆15Updated this week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Kubernetes Node-Local DNS Cache☆12Updated this week
- ☆11Nov 10, 2025Updated 11 months ago
- Apache NiFi deployment on OpenShift☆13Jul 18, 2023Updated 3 years ago
- Repository of helpers to run chaos experiments with k6☆12Nov 2, 2022Updated 4 years ago
- Kubernetes Admission Webhook to enforce pulling of Docker images from the private registry.☆45May 21, 2021Updated 5 years ago
- Expand CIDRs or wrangle a list of IPs back to its smallest CIDR blocks possible☆10Apr 5, 2020Updated 6 years ago
- Cloud Run API Emulator provides application developers with a locally-running, emulated instance of Cloud Run API to enable local develop…☆13Oct 25, 2025Updated last year
- ☆11Mar 15, 2022Updated 4 years ago
- A k6 extension for Google PubSub.☆10Jul 11, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Gateway API Inference Extension☆801Updated this week
- Anteckningar etc, som rör ENA's utforskande för Samverkansplattform Öppen Programvara☆12Oct 10, 2025Updated last year
- A Terminal User Interface (TUI) for interacting with Language Learning Models (LLM) directly from your command line written in Rust.☆15Apr 29, 2025Updated last year
- Model as a Service☆47Updated this week
- VAST's Container Storage Interface (CSI) Driver☆30Updated this week
- GPU Kernel Manager Operator☆12Nov 1, 2026Updated last week
- Kubernetes controllers for fast model actuation using vLLM sleep/wake and launcher-based model swapping☆28Updated this week