Triton backend for managing the model state tensors automatically in sequence batcher
☆17Feb 12, 2024Updated 2 years ago
Alternatives and similar repositories for stateful_backend
Users that are interested in stateful_backend are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TRITONCACHE implementation of a Redis cache☆18Sep 11, 2026Updated last week
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆226May 27, 2026Updated 3 months ago
- The core library and APIs implementing the Triton Inference Server.☆184Sep 17, 2026Updated last week
- API and CLI tool to fetch and query Chome DevTools heap snapshots (Python & Playwright)☆16May 16, 2024Updated 2 years ago
- lshash for python3☆10Mar 21, 2018Updated 8 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Reliability layer for multi-agent setups — keep agents coordinating without an orchestrator. Cross-dialog contracts + drift detection + b…☆290Updated this week
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆11Dec 13, 2023Updated 2 years ago
- Template and steps to build your personal blog using Jekyll and Minimal Mistake☆10Feb 24, 2020Updated 6 years ago
- ☆36Feb 9, 2024Updated 2 years ago
- Nsight Compute In Docker☆13Dec 21, 2023Updated 2 years ago
- ☆12May 22, 2022Updated 4 years ago
- convert PubLayNet data into METS/PAGE-XML☆10Mar 17, 2020Updated 6 years ago
- ☆11Nov 14, 2021Updated 4 years ago
- ☆10Oct 6, 2015Updated 10 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Official Implementation of "Transferring Inductive Biases Through Knowledge Distillation"☆15Jun 3, 2020Updated 6 years ago
- The Triton backend for the ONNX Runtime.☆187Updated this week
- ☆18Apr 15, 2024Updated 2 years ago
- A Kubernetes operator for managing Prefect servers and work pools☆23Updated this week
- A set of tools that make working with the Scala ecosystem even better.☆15Updated this week
- Minimal workflows☆22Mar 19, 2024Updated 2 years ago
- A simple example of how to bind C++ code in Python☆14Nov 13, 2020Updated 5 years ago
- ☆10Nov 15, 2016Updated 9 years ago
- Docker images for GStreamer☆15May 29, 2018Updated 8 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Book code for Testing in Scala on O'Reilly☆14May 29, 2014Updated 12 years ago
- An in-memory compressed cache for gigabytes of data written in Go.☆18Feb 6, 2023Updated 3 years ago
- detection card and recognize the name、numbers and date☆12Jun 28, 2018Updated 8 years ago
- ☆16Nov 24, 2025Updated 10 months ago
- ☆12May 19, 2021Updated 5 years ago
- Universal Character Recognizer (UCR): Simple, Intuitive, Extensible, Multi-Lingual OCR engine☆15Apr 23, 2021Updated 5 years ago
- All in How You Ask for It: Simple Black-Box Method for Jailbreak Attacks☆17Apr 24, 2024Updated 2 years ago
- Kerberos ticket delegation and impersonation for Batch/CI/CD environments☆22Jul 28, 2026Updated last month
- This is a fork of SGLang for hip-attention integration. Please refer to hip-attention for detail.☆18Mar 31, 2026Updated 5 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- 🎙️ Automatically transcribe audio/video into high-quality, speaker-specific Text-To-Speech datasets ✨☆18May 20, 2025Updated last year
- Code for paper "Learning to Plan with Uncertain Topological Maps"☆10Aug 28, 2020Updated 6 years ago
- A utility to inspect, validate, sign and verify machine learning model files.☆66Feb 5, 2025Updated last year
- A fork of the PEFT library, supporting Robust Adaptation (RoSA)☆15Aug 16, 2024Updated 2 years ago
- Spark—Python学习笔记☆10Sep 25, 2018Updated 7 years ago
- Some microbenchmarks and design docs before commencement☆11Feb 1, 2021Updated 5 years ago
- Problems from Project Euler☆18Feb 5, 2019Updated 7 years ago