Triton backend for managing the model state tensors automatically in sequence batcher
☆16Feb 12, 2024Updated 2 years ago
Alternatives and similar repositories for stateful_backend
Users that are interested in stateful_backend are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TRITONCACHE implementation of a Redis cache☆17Apr 8, 2026Updated last week
- The core library and APIs implementing the Triton Inference Server.☆169Updated this week
- Community Eventing and Scripting examples☆19Aug 11, 2025Updated 8 months ago
- Homebrew formulas for installing LLM and related tools☆14Sep 6, 2023Updated 2 years ago
- This repository corresponds to the PICCO compiler for secure multi-party computation published in 2013 with more recent efficiency improv…☆12Apr 6, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆842Aug 13, 2025Updated 8 months ago
- ☆18May 6, 2023Updated 2 years ago
- Arxiv + Notion Sync☆20May 12, 2025Updated 11 months ago
- Fast and memory-efficient exact attention☆20Updated this week
- An agent that can run everywhere - even in your watch!☆30Apr 8, 2026Updated last week
- Book code for Testing in Scala on O'Reilly☆14May 29, 2014Updated 11 years ago
- Student version of Mini-SLAM.☆10Mar 16, 2024Updated 2 years ago
- Noncanonical (but only existing) repo for the pijnu PEG parser☆25Jul 30, 2011Updated 14 years ago
- ☆17Feb 5, 2015Updated 11 years ago
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Example agents for the Dreadnode platform☆31Dec 19, 2025Updated 3 months ago
- The Triton backend for the ONNX Runtime.☆174Updated this week
- Samples of HTTP traffic☆38Jan 20, 2013Updated 13 years ago
- Beep, as an ALSA MIDI device☆14Mar 29, 2021Updated 5 years ago
- Simple Event Driven Network Library☆33Nov 7, 2017Updated 8 years ago
- ☆37May 5, 2013Updated 12 years ago
- a performant, embedded database☆20Mar 4, 2025Updated last year
- Typesafe Activator template for advanced play-slick project☆20Jan 16, 2017Updated 9 years ago
- Minimal workflows☆21Mar 19, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Binary rational numbers in Coq [maintainer=@herbelin]☆15Dec 30, 2023Updated 2 years ago
- ☆28Oct 8, 2015Updated 10 years ago
- Solve the advection diffusion equations looped into an optimization problem with JAX/autodiff☆14May 8, 2025Updated 11 months ago
- Small, simple agent task environments for training and evaluation☆19Nov 1, 2024Updated last year
- A simple wrapper of an IO computation to show the used CPU time.☆16Mar 14, 2025Updated last year
- Code of paper "A Video Dataset for Falling Object Detection around Buildings" https://arxiv.org/abs/2408.05750☆18Jul 10, 2025Updated 9 months ago
- ☆19Sep 22, 2015Updated 10 years ago
- ☆16Sep 27, 2023Updated 2 years ago
- Spark—Python学习笔记☆11Sep 25, 2018Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆13Mar 1, 2021Updated 5 years ago
- Transform generic LLMs into specialized, fast and efficient models.☆45Updated this week
- Busy Beaver deciders backed by Coq proof☆17Apr 7, 2026Updated last week
- All in How You Ask for It: Simple Black-Box Method for Jailbreak Attacks☆18Apr 24, 2024Updated last year
- How to Design a Language Agnostic SDK for Cross Platform Deployment and Maximum Extensibility: A Tutorial☆20Nov 21, 2022Updated 3 years ago
- Small library for creating RPC service without any headache☆15Oct 30, 2018Updated 7 years ago
- A Very Simple Vector Database☆15May 1, 2023Updated 2 years ago