Triton backend for managing the model state tensors automatically in sequence batcher
☆17Feb 12, 2024Updated 2 years ago
Alternatives and similar repositories for stateful_backend
Users that are interested in stateful_backend are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TRITONCACHE implementation of a Redis cache☆17Jun 9, 2026Updated 3 weeks ago
- ☆33Jul 7, 2022Updated 3 years ago
- The core library and APIs implementing the Triton Inference Server.☆175Jun 27, 2026Updated last week
- Community Eventing and Scripting examples☆19Aug 11, 2025Updated 10 months ago
- simple golang deep learning framework☆10Jul 5, 2021Updated 5 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆844Aug 13, 2025Updated 10 months ago
- Link Python logic with Svelte interfaces for simple demos☆14Jan 9, 2025Updated last year
- A lock-free, thread-safe, multi-producer/multi-consumer queue based on the LMAX Disruptor.☆16Apr 20, 2021Updated 5 years ago
- Arxiv + Notion Sync☆20May 12, 2025Updated last year
- A jupyter client for your terminal☆27Jan 3, 2026Updated 6 months ago
- Nsight Compute In Docker☆13Dec 21, 2023Updated 2 years ago
- An agent that can run everywhere - even in your watch!☆33Apr 8, 2026Updated 2 months ago
- ☆36Feb 9, 2024Updated 2 years ago
- DSPy: The framework for programming with foundation models☆13Aug 24, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A framework for creating message-driven training systems with PyTorch☆21Oct 7, 2025Updated 8 months ago
- Student version of Mini-SLAM.☆10Mar 16, 2024Updated 2 years ago
- cursor logs with gpt-4o using litellm proxy☆14Sep 9, 2025Updated 9 months ago
- ☆10Mar 16, 2023Updated 3 years ago
- convert PubLayNet data into METS/PAGE-XML☆10Mar 17, 2020Updated 6 years ago
- Provides for deploying custom ETL containers on AIStore, with subsequent user-defined extraction-transformation-loading in parallel, on t…☆22Updated this week
- ☆17Feb 5, 2015Updated 11 years ago
- Official Implementation of "Transferring Inductive Biases Through Knowledge Distillation"☆15Jun 3, 2020Updated 6 years ago
- GenericInjector for win32 programs☆12Jun 19, 2017Updated 9 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- The Triton backend for the ONNX Runtime.☆180Jun 27, 2026Updated last week
- ☆41Jan 30, 2026Updated 5 months ago
- An in-memory compressed cache for gigabytes of data written in Go.☆19Feb 6, 2023Updated 3 years ago
- Samples of HTTP traffic☆38Jan 20, 2013Updated 13 years ago
- The (open-source part of) code to reproduce "BPPSA: Scaling Back-propagation by Parallel Scan Algorithm".☆13Jun 7, 2021Updated 5 years ago
- ICP implementation in Rust☆17Jun 27, 2024Updated 2 years ago
- Beep, as an ALSA MIDI device☆14Mar 29, 2021Updated 5 years ago
- ☆37May 5, 2013Updated 13 years ago
- a performant, embedded database☆20Mar 4, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Typesafe Activator template for advanced play-slick project☆20Jan 16, 2017Updated 9 years ago
- A set of tools that make working with the Scala ecosystem even better.☆13Updated this week
- ☆14Mar 1, 2023Updated 3 years ago
- Minimal workflows☆22Mar 19, 2024Updated 2 years ago
- A lightweight reactive RPC-like system built on Akka IO☆46Apr 23, 2015Updated 11 years ago
- 🎙️ Automatically transcribe audio/video into high-quality, speaker-specific Text-To-Speech datasets ✨☆18May 20, 2025Updated last year
- ☆10Nov 15, 2016Updated 9 years ago