Triton backend for managing the model state tensors automatically in sequence batcher
☆17Feb 12, 2024Updated 2 years ago
Alternatives and similar repositories for stateful_backend
Users that are interested in stateful_backend are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆224May 27, 2026Updated 2 months ago
- ☆33Jul 7, 2022Updated 4 years ago
- simple golang deep learning framework☆10Jul 5, 2021Updated 5 years ago
- LobotoMl is a set of scripts and tools to assess production deployments of ML services☆10May 16, 2022Updated 4 years ago
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆847Aug 13, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Link Python logic with Svelte interfaces for simple demos☆14Jan 9, 2025Updated last year
- ☆18May 6, 2023Updated 3 years ago
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆11Dec 13, 2023Updated 2 years ago
- DSPy: The framework for programming with foundation models☆13Aug 24, 2023Updated 2 years ago
- ☆36Feb 9, 2024Updated 2 years ago
- Nsight Compute In Docker☆13Dec 21, 2023Updated 2 years ago
- The Triton backend for the ONNX Runtime.☆186Updated this week
- Community Eventing and Scripting examples☆20Aug 11, 2025Updated last year
- Forensic Reconstruction of Severely Degraded License Plates, Electronic Imaging, 2019.☆18Apr 27, 2022Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A Kubernetes operator for managing Prefect servers and work pools☆22Updated this week
- A set of tools that make working with the Scala ecosystem even better.☆15Updated this week
- Rust binding to libtailscale☆33Feb 22, 2026Updated 5 months ago
- A Field-Theoretic Approach to Unbounded Memory in Large Language Models☆20Apr 15, 2025Updated last year
- All in How You Ask for It: Simple Black-Box Method for Jailbreak Attacks☆17Apr 24, 2024Updated 2 years ago
- ☆15Mar 12, 2022Updated 4 years ago
- Distributed Reinforcement Learning for LLM Fine-Tuning with multi-GPU utilization☆22Mar 12, 2025Updated last year
- Kerberos ticket delegation and impersonation for Batch/CI/CD environments☆22Jul 28, 2026Updated 2 weeks ago
- This is a fork of SGLang for hip-attention integration. Please refer to hip-attention for detail.☆18Mar 31, 2026Updated 4 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- 🎙️ Automatically transcribe audio/video into high-quality, speaker-specific Text-To-Speech datasets ✨☆18May 20, 2025Updated last year
- Code for paper "Learning to Plan with Uncertain Topological Maps"☆10Aug 28, 2020Updated 5 years ago
- Spark—Python学习笔记☆10Sep 25, 2018Updated 7 years ago
- Dynamic Adversarial Benchmarking platform☆26Jun 22, 2022Updated 4 years ago
- MMLU eval for RU/EN☆16Jul 31, 2023Updated 3 years ago
- Some microbenchmarks and design docs before commencement☆11Feb 1, 2021Updated 5 years ago
- Problems from Project Euler☆18Feb 5, 2019Updated 7 years ago
- Small library for creating RPC service without any headache☆15Oct 30, 2018Updated 7 years ago
- VPN-Chainer – Chain multiple WireGuard VPNs dynamically, select the fastest with --fastest, and rotate them via API. Includes auto-routin…☆21Jul 29, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Official PyTorch Implementation for Meaning Representations from Trajectories in Autoregressive Models (ICLR 2024)☆22May 14, 2024Updated 2 years ago
- Python Camouflage Pattern Generator, GUI available☆26Apr 22, 2026Updated 3 months ago
- A framework for creating message-driven training systems with PyTorch☆21Aug 2, 2026Updated last week
- A Very Simple Vector Database☆15May 1, 2023Updated 3 years ago
- ☆23May 1, 2024Updated 2 years ago
- Nearest neighbor search for Ruby and S3 Vectors☆14Apr 9, 2026Updated 4 months ago
- A live video stream license plate detector based on OpenALPR☆22Oct 1, 2020Updated 5 years ago