Triton backend for managing the model state tensors automatically in sequence batcher
☆17Feb 12, 2024Updated 2 years ago
Alternatives and similar repositories for stateful_backend
Users that are interested in stateful_backend are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TRITONCACHE implementation of a Redis cache☆17May 8, 2026Updated 2 weeks ago
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆221Feb 3, 2026Updated 3 months ago
- ☆33Jul 7, 2022Updated 3 years ago
- The core library and APIs implementing the Triton Inference Server.☆171Updated this week
- Homebrew formulas for installing LLM and related tools☆14Sep 6, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Tool for parsing 'ugly' numbers and units☆14Apr 23, 2025Updated last year
- A Kubernetes operator for managing Prefect servers and work pools☆17Updated this week
- This repository corresponds to the PICCO compiler for secure multi-party computation published in 2013 with more recent efficiency improv…☆12Apr 30, 2026Updated 3 weeks ago
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆844Aug 13, 2025Updated 9 months ago
- ☆18May 6, 2023Updated 3 years ago
- A lock-free, thread-safe, multi-producer/multi-consumer queue based on the LMAX Disruptor.☆16Apr 20, 2021Updated 5 years ago
- Arxiv + Notion Sync☆20May 12, 2025Updated last year
- Bluesky bot — mention it and it sentiment-scores your last 100 posts (AFINN)☆12Apr 25, 2026Updated last month
- Nsight Compute In Docker☆13Dec 21, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆36Feb 9, 2024Updated 2 years ago
- ☆38Jan 30, 2026Updated 3 months ago
- A framework for creating message-driven training systems with PyTorch☆21Oct 7, 2025Updated 7 months ago
- Book code for Testing in Scala on O'Reilly☆14May 29, 2014Updated 11 years ago
- Beep the PC speaker☆11Nov 9, 2022Updated 3 years ago
- Noncanonical (but only existing) repo for the pijnu PEG parser☆25Jul 30, 2011Updated 14 years ago
- ☆10Mar 16, 2023Updated 3 years ago
- convert PubLayNet data into METS/PAGE-XML☆10Mar 17, 2020Updated 6 years ago
- ☆12May 22, 2022Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆17Feb 5, 2015Updated 11 years ago
- Official Implementation of "Transferring Inductive Biases Through Knowledge Distillation"☆15Jun 3, 2020Updated 5 years ago
- ☆11Nov 14, 2021Updated 4 years ago
- ☆10Oct 6, 2015Updated 10 years ago
- GenericInjector for win32 programs☆12Jun 19, 2017Updated 8 years ago
- The Triton backend for the ONNX Runtime.☆176Updated this week
- Samples of HTTP traffic☆38Jan 20, 2013Updated 13 years ago
- ☆18Apr 15, 2024Updated 2 years ago
- Example agents for the Dreadnode platform☆33Dec 19, 2025Updated 5 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Beep, as an ALSA MIDI device☆14Mar 29, 2021Updated 5 years ago
- Simple Event Driven Network Library☆33Nov 7, 2017Updated 8 years ago
- Typesafe Activator template for advanced play-slick project☆20Jan 16, 2017Updated 9 years ago
- A set of tools that make working with the Scala ecosystem even better.☆13Apr 4, 2026Updated last month
- ☆14Mar 1, 2023Updated 3 years ago
- Homepage of Software Engineering for Machine Learning☆17Updated this week
- A lightweight reactive RPC-like system built on Akka IO☆45Apr 23, 2015Updated 11 years ago