Triton backend for managing the model state tensors automatically in sequence batcher
☆17Feb 12, 2024Updated 2 years ago
Alternatives and similar repositories for stateful_backend
Users that are interested in stateful_backend are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TRITONCACHE implementation of a Redis cache☆18Updated this week
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆224May 27, 2026Updated last month
- simple golang deep learning framework☆10Jul 5, 2021Updated 5 years ago
- LobotoMl is a set of scripts and tools to assess production deployments of ML services☆10May 16, 2022Updated 4 years ago
- Tool for parsing 'ugly' numbers and units☆14Apr 23, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆846Aug 13, 2025Updated 11 months ago
- ☆18May 6, 2023Updated 3 years ago
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆11Dec 13, 2023Updated 2 years ago
- Template and steps to build your personal blog using Jekyll and Minimal Mistake☆10Feb 24, 2020Updated 6 years ago
- ☆12May 22, 2022Updated 4 years ago
- The benchmark for financial time series forecasting.☆16Jul 19, 2025Updated last year
- ☆10Mar 16, 2023Updated 3 years ago
- ☆11Nov 14, 2021Updated 4 years ago
- ☆10Oct 6, 2015Updated 10 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Official Implementation of "Transferring Inductive Biases Through Knowledge Distillation"☆15Jun 3, 2020Updated 6 years ago
- The Triton backend for the ONNX Runtime.☆184Updated this week
- GenericInjector for win32 programs☆12Jun 19, 2017Updated 9 years ago
- ☆18Apr 15, 2024Updated 2 years ago
- A set of tools that make working with the Scala ecosystem even better.☆13Updated this week
- Minimal workflows☆22Mar 19, 2024Updated 2 years ago
- ☆10Nov 15, 2016Updated 9 years ago
- Book code for Testing in Scala on O'Reilly☆14May 29, 2014Updated 12 years ago
- detection card and recognize the name、numbers and date☆12Jun 28, 2018Updated 8 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆12May 19, 2021Updated 5 years ago
- Universal Character Recognizer (UCR): Simple, Intuitive, Extensible, Multi-Lingual OCR engine☆15Apr 23, 2021Updated 5 years ago
- All in How You Ask for It: Simple Black-Box Method for Jailbreak Attacks☆17Apr 24, 2024Updated 2 years ago
- Distributed Reinforcement Learning for LLM Fine-Tuning with multi-GPU utilization☆22Mar 12, 2025Updated last year
- This is a fork of SGLang for hip-attention integration. Please refer to hip-attention for detail.☆19Mar 31, 2026Updated 3 months ago
- Spark—Python学习笔记☆11Sep 25, 2018Updated 7 years ago
- MMLU eval for RU/EN☆16Jul 31, 2023Updated 2 years ago
- Problems from Project Euler☆18Feb 5, 2019Updated 7 years ago
- Small library for creating RPC service without any headache☆15Oct 30, 2018Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- VPN-Chainer – Chain multiple WireGuard VPNs dynamically, select the fastest with --fastest, and rotate them via API. Includes auto-routin…☆21Jul 29, 2025Updated 11 months ago
- Official PyTorch Implementation for Meaning Representations from Trajectories in Autoregressive Models (ICLR 2024)☆22May 14, 2024Updated 2 years ago
- Python Camouflage Pattern Generator, GUI available☆26Apr 22, 2026Updated 3 months ago
- A Java library for managing child processes.☆19Dec 8, 2015Updated 10 years ago
- AI assistance☆12Jan 5, 2023Updated 3 years ago
- Simple, safe way to store and distribute tensors☆15Jun 29, 2026Updated 3 weeks ago
- ☆23May 1, 2024Updated 2 years ago