Triton backend for managing the model state tensors automatically in sequence batcher
☆17Feb 12, 2024Updated 2 years ago
Alternatives and similar repositories for stateful_backend
Users that are interested in stateful_backend are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TRITONCACHE implementation of a Redis cache☆18Updated this week
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆226May 27, 2026Updated 4 months ago
- ☆33Jul 7, 2022Updated 4 years ago
- The core library and APIs implementing the Triton Inference Server.☆184Updated this week
- simple golang deep learning framework☆10Jul 5, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- API and CLI tool to fetch and query Chome DevTools heap snapshots (Python & Playwright)☆16May 16, 2024Updated 2 years ago
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆849Aug 13, 2025Updated last year
- Rust crate for submitting inference requests to machine learning models☆15May 24, 2024Updated 2 years ago
- An HTTP proxy that naively injects NTLM data for the current user into outgoing requests☆14Nov 14, 2018Updated 7 years ago
- Link Python logic with Svelte interfaces for simple demos☆14Jan 9, 2025Updated last year
- ☆36Feb 9, 2024Updated 2 years ago
- Python client for the Open eXecution Protocol (OXP)☆18May 16, 2025Updated last year
- ☆12May 22, 2022Updated 4 years ago
- convert PubLayNet data into METS/PAGE-XML☆10Mar 17, 2020Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- cursor logs with gpt-4o using litellm proxy☆14Sep 9, 2025Updated last year
- ☆10Mar 16, 2023Updated 3 years ago
- The benchmark for financial time series forecasting.☆17Jul 19, 2025Updated last year
- Johann, the lightweight and flexible scenario orchestrator☆12Oct 3, 2022Updated 4 years ago
- ☆11Nov 14, 2021Updated 4 years ago
- Official Implementation of "Transferring Inductive Biases Through Knowledge Distillation"☆16Jun 3, 2020Updated 6 years ago
- The Triton backend for the ONNX Runtime.☆187Updated this week
- GenericInjector for win32 programs☆12Jun 19, 2017Updated 9 years ago
- Small, simple agent task environments for training and evaluation☆20Nov 1, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Community Eventing and Scripting examples☆22Aug 11, 2025Updated last year
- Forensic Reconstruction of Severely Degraded License Plates, Electronic Imaging, 2019.☆18Apr 27, 2022Updated 4 years ago
- A Kubernetes operator for managing Prefect servers and work pools☆23Oct 5, 2026Updated last week
- Rust binding to libtailscale☆34Feb 22, 2026Updated 7 months ago
- Minimal workflows☆22Mar 19, 2024Updated 2 years ago
- ☆10Nov 15, 2016Updated 9 years ago
- Book code for Testing in Scala on O'Reilly☆14May 29, 2014Updated 12 years ago
- An in-memory compressed cache for gigabytes of data written in Go.☆18Feb 6, 2023Updated 3 years ago
- detection card and recognize the name、numbers and date☆12Jun 28, 2018Updated 8 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A Field-Theoretic Approach to Unbounded Memory in Large Language Models☆20Apr 15, 2025Updated last year
- ☆16Nov 24, 2025Updated 10 months ago
- ☆12May 19, 2021Updated 5 years ago
- Distributed Reinforcement Learning for LLM Fine-Tuning with multi-GPU utilization☆22Mar 12, 2025Updated last year
- service↔machine discovery with a friendly REST API☆18Jun 4, 2014Updated 12 years ago
- Kerberos ticket delegation and impersonation for Batch/CI/CD environments☆22Jul 28, 2026Updated 2 months ago
- This is a fork of SGLang for hip-attention integration. Please refer to hip-attention for detail.☆18Mar 31, 2026Updated 6 months ago