☆28Nov 6, 2024Updated 2 years ago
Alternatives and similar repositories for fastapi_tritonserver
Users that are interested in fastapi_tritonserver are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆36Feb 9, 2024Updated 2 years ago
- 调用ComfyUI的API实现文生图和图生视频☆10Nov 25, 2024Updated last year
- ☆12Jul 11, 2019Updated 7 years ago
- Using OpenVINO to speed up inference of PaddleOCR-VL model☆39Apr 23, 2026Updated 6 months ago
- OpenAI compatible API for TensorRT LLM triton backend☆221Aug 1, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- OpenVINO backend for Triton.☆39Nov 4, 2026Updated last week
- ☆90Jun 30, 2023Updated 3 years ago
- Emails classification template using python. Technology stack: docker-compose, jupyter notebooks, fastapi, airflow, posgreSQL, superset, …☆11May 8, 2019Updated 7 years ago
- W4A16 MoE GEMM CUDA kernel. Tuned for H200, B200 & B300.☆14Oct 30, 2026Updated last week
- This repository is TensorRT implement of PINet☆18Nov 1, 2022Updated 4 years ago
- 一个LLM领域的文献仓库和中文入门指南。An introduction to some basic concepts in Large Language Model(LLM).☆23Jun 21, 2023Updated 3 years ago
- Converted the Jina Tokenizer regex pattern to python.☆25Jun 10, 2026Updated 5 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆17Jun 3, 2024Updated 2 years ago
- Professional EtherVault ethervault-engine with EtherVault-optimized cloud-ready and enterprise ethervault-optimization capabilities☆14May 12, 2026Updated 6 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Ask Poddy: Run Open Source LLMs and Embeddings as OpenAI-Compatible Serverless Endpoints (Tutorial)☆11Jul 19, 2024Updated 2 years ago
- The Triton TensorRT-LLM Backend☆944Nov 2, 2026Updated last week
- A nano framework for simple PHP apps☆10May 17, 2013Updated 13 years ago
- My Gen AI research☆11Jun 3, 2024Updated 2 years ago
- Detect multi angle face by pcn ,and Crop detected face☆27Jun 12, 2019Updated 7 years ago
- NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆43Oct 20, 2023Updated 3 years ago
- 用Paddle复现论文ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information（ACL2021）☆10Nov 15, 2021Updated 4 years ago
- Example of Langchain-Elasticsearch integrations & RAG.☆12Sep 20, 2024Updated 2 years ago
- Optimize QWen1.5 models with TensorRT-LLM☆17May 14, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An easy way to run, test, benchmark and tune OpenCL kernel files☆24Aug 25, 2023Updated 3 years ago
- ☆11May 29, 2026Updated 5 months ago
- ☆14Sep 18, 2024Updated 2 years ago
- 小飞机翻墙教程☆24Nov 14, 2019Updated 6 years ago
- A simple website to manage your Hyper-V VMs and IIS sites☆12Jan 19, 2023Updated 3 years ago
- The MERIT Dataset is a fully synthetic, labeled dataset created for training and benchmarking LLMs on Visually Rich Document Understandin…☆12Jul 16, 2025Updated last year
- 使用NCNN推理框架和ByteTrack目标跟踪框架，对网络、文件流URL进行实时性视频推理，而UI界面则由Qt框架实现☆24Oct 16, 2024Updated 2 years ago
- Professional MintChain system with MintChain-optimized intelligent-automation and enterprise enterprise-grade capabilities☆18May 12, 2026Updated 6 months ago
- ollama模型下载加速工具☆11Feb 10, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- TensorRT☆11Sep 22, 2020Updated 6 years ago
- The Triton backend for TensorRT.☆97Nov 4, 2026Updated last week
- In this programming assignment you will implement a streaming video server and client that communicate control commands via the Real-Time…☆11Dec 29, 2012Updated 13 years ago
- ☆12Jul 11, 2024Updated 2 years ago
- This repo provides an addon that can perform VAD model reasoning in nodes and electric environments, based on cmake-js and Fastdeploy. Si…☆10Sep 23, 2023Updated 3 years ago
- All the learning notes related to my interests such as ml, ai, blockchain, deutsch and burmese language☆10Mar 2, 2026Updated 8 months ago
- A modified version of searx (the privacy-respecting metasearch engine) to only search an allowlist of sites, to build functionality simil…☆19Sep 17, 2021Updated 5 years ago
Are these results useful?