Triton backend for managing the model state tensors automatically in sequence batcher
☆17Feb 12, 2024Updated 2 years ago
Alternatives and similar repositories for stateful_backend
Users that are interested in stateful_backend are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TRITONCACHE implementation of a Redis cache☆18Aug 17, 2026Updated 2 weeks ago
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆225May 27, 2026Updated 3 months ago
- simple golang deep learning framework☆10Jul 5, 2021Updated 5 years ago
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆848Aug 13, 2025Updated last year
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆11Dec 13, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆12May 22, 2022Updated 4 years ago
- convert PubLayNet data into METS/PAGE-XML☆10Mar 17, 2020Updated 6 years ago
- cursor logs with gpt-4o using litellm proxy☆14Sep 9, 2025Updated 11 months ago
- The Triton backend for the ONNX Runtime.☆186Updated this week
- GenericInjector for win32 programs☆12Jun 19, 2017Updated 9 years ago
- Community Eventing and Scripting examples☆22Aug 11, 2025Updated last year
- Compare Savant and PyTorch performance☆13Feb 9, 2024Updated 2 years ago
- A Kubernetes operator for managing Prefect servers and work pools☆23Updated this week
- FreeNAC provides dynamic vlan assignment, live inventory and LAN access control for Cisco Switches and all kinds of Network devices (PC, …☆30Nov 4, 2013Updated 12 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Rust binding to libtailscale☆34Feb 22, 2026Updated 6 months ago
- Book code for Testing in Scala on O'Reilly☆14May 29, 2014Updated 12 years ago
- detection card and recognize the name、numbers and date☆12Jun 28, 2018Updated 8 years ago
- ☆16Nov 24, 2025Updated 9 months ago
- ☆12May 19, 2021Updated 5 years ago
- Universal Character Recognizer (UCR): Simple, Intuitive, Extensible, Multi-Lingual OCR engine☆15Apr 23, 2021Updated 5 years ago
- All in How You Ask for It: Simple Black-Box Method for Jailbreak Attacks☆17Apr 24, 2024Updated 2 years ago
- service↔machine discovery with a friendly REST API☆18Jun 4, 2014Updated 12 years ago
- This is a fork of SGLang for hip-attention integration. Please refer to hip-attention for detail.☆18Mar 31, 2026Updated 5 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Code for paper "Learning to Plan with Uncertain Topological Maps"☆10Aug 28, 2020Updated 6 years ago
- Spark—Python学习笔记☆10Sep 25, 2018Updated 7 years ago
- MMLU eval for RU/EN☆16Jul 31, 2023Updated 3 years ago
- Messaging between C++ and Python using RabbitMQ☆11Aug 17, 2018Updated 8 years ago
- Some microbenchmarks and design docs before commencement☆11Feb 1, 2021Updated 5 years ago
- Official PyTorch Implementation for Meaning Representations from Trajectories in Autoregressive Models (ICLR 2024)☆22May 14, 2024Updated 2 years ago
- AI assistance☆12Jan 5, 2023Updated 3 years ago
- Simple, safe way to store and distribute tensors☆15Jun 29, 2026Updated 2 months ago
- React Hooks for Agora NG SDK https://agoraio-community.github.io/AgoraWebSDK-NG/en/☆12Nov 24, 2020Updated 5 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Provides for deploying custom ETL containers on AIStore, with subsequent user-defined extraction-transformation-loading in parallel, on t…☆22Updated this week
- Nearest neighbor search for Ruby and S3 Vectors☆14Apr 9, 2026Updated 4 months ago
- The Slick Akka Http Oauth2 is a template for using akka-http with slick, with scala-oauth2 integrated☆13Jan 26, 2017Updated 9 years ago
- FIL backend for the Triton Inference Server☆94Aug 17, 2026Updated 2 weeks ago
- Server side document handling with improved output handling and kernel management/status.☆19Updated this week
- ☆17Nov 26, 2024Updated last year
- Python3 library for sophisticated timing attacks using Gaussian Mixture Model.☆22Apr 10, 2022Updated 4 years ago