☆27Nov 6, 2024Updated last year
Alternatives and similar repositories for fastapi_tritonserver
Users that are interested in fastapi_tritonserver are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆619Jul 31, 2024Updated last year
- OpenVINO backend for Triton.☆37May 8, 2026Updated 2 weeks ago
- YOLO v5 Object Detection on Triton Inference Server☆17Mar 30, 2023Updated 3 years ago
- OpenAI compatible API for TensorRT LLM triton backend☆220Aug 1, 2024Updated last year
- Add genai backend for ollama to run generative AI models using OpenVINO Runtime.☆30Apr 16, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A high-throughput and memory-efficient inference and serving engine for LLMs☆17Jun 3, 2024Updated last year
- Converted the Jina Tokenizer regex pattern to python.☆26Aug 26, 2024Updated last year
- The Triton backend for TensorRT.☆88May 8, 2026Updated 2 weeks ago
- ☆17Jul 14, 2023Updated 2 years ago
- The Triton TensorRT-LLM Backend☆934May 7, 2026Updated 2 weeks ago
- Inference TinyLlama models on ncnn☆24Aug 15, 2023Updated 2 years ago
- ☆90Jun 30, 2023Updated 2 years ago
- This project provides a production-ready, real-time inference server for LatentSync, enabling high-quality, low-latency 2D digital human …☆24Aug 16, 2025Updated 9 months ago
- A simple website to manage your Hyper-V VMs and IIS sites☆12Jan 19, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆14Sep 18, 2024Updated last year
- [SIGGRAPH Asia 2025] The official implementation of the paper "DvD: Unleashing a Generative Paradigm for Document Dewarping via Coordinat…☆33Mar 10, 2026Updated 2 months ago
- MobileSAM のエンコーダー/デコーダーをONNXに変換し、推論するサンプル☆12Apr 11, 2024Updated 2 years ago
- NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆43Oct 20, 2023Updated 2 years ago
- A Flutter plugin to use ncnn, a high-performance neural network inference framework optimized for the mobile platform.☆21Nov 30, 2023Updated 2 years ago
- A vllm proxy server to add security and multi model management for vllm servers☆12May 30, 2024Updated last year
- 用Paddle复现论文ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information（ACL2021）☆10Nov 15, 2021Updated 4 years ago
- Example of Langchain-Elasticsearch integrations & RAG.☆12Sep 20, 2024Updated last year
- Optimize QWen1.5 models with TensorRT-LLM☆17May 14, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- clone of https://code.google.com/p/opencl-book-samples (there's an official repo here https://github.com/bgaster/opencl-book-samples)☆48Mar 26, 2013Updated 13 years ago
- ☆10Jul 18, 2024Updated last year
- Kokoro Manim Voiceover☆16Jan 14, 2026Updated 4 months ago
- Detect multi angle face by pcn ,and Crop detected face☆28Jun 12, 2019Updated 6 years ago
- PyMiner 开发者指南☆12Mar 19, 2022Updated 4 years ago
- Code for testing the native float16 matrix multiplication performance on Tesla P100 and V100 GPU based on cublasHgemm☆35Aug 20, 2019Updated 6 years ago
- Deep Learning Deployment Framework: Supports tf/torch/trt/trtllm/vllm and other NN frameworks. Support dynamic batching, and streaming mo…☆169May 8, 2025Updated last year
- 仿微信录像和拍照，record Video and photo functions☆21May 22, 2023Updated 3 years ago
- TensorRT☆11Sep 22, 2020Updated 5 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- a game framework. warning: wip, dev, unstable, radiation hazard, defcon 3☆24May 10, 2015Updated 11 years ago
- A modified version of searx (the privacy-respecting metasearch engine) to only search an allowlist of sites, to build functionality simil…☆19Sep 17, 2021Updated 4 years ago
- inference on tvm runtime using c++ with gpu enabled☆10Apr 25, 2018Updated 8 years ago
- ☆12Jan 25, 2023Updated 3 years ago
- ☆21Jun 4, 2024Updated last year
- triton server ensemble model demo☆30May 2, 2022Updated 4 years ago
- Tokun to can tokens☆18Jun 19, 2025Updated 11 months ago