Using TensorRT and Triton Server to build BERT model as a service
☆13Jan 10, 2022Updated 4 years ago
Alternatives and similar repositories for faster-bert-as-service
Users that are interested in faster-bert-as-service are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 针对NER领域提供从线下训练到线上部署的一整套闭环流程☆14Jun 16, 2021Updated 5 years ago
- 将Yolov3模型转成可以进行动态Batch的TensorRT推理以及Triton Inference Serving上部署的TensorRT模型☆29Jan 7, 2021Updated 5 years ago
- Convert BART models to ONNX with quantization. 3X reduction in size, and upto 3X boost in inference speed☆33Dec 11, 2024Updated last year
- communication sur le moteur de pseudonymisation de la Cour de Cassation☆19Feb 14, 2023Updated 3 years ago
- CHIP2021医学对话临床发现阴阳性判别任务冠军方案☆17Mar 11, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Non Metric Space ( Approximate ) Library in R☆12Feb 2, 2023Updated 3 years ago
- MXNet Model Serving☆25Oct 4, 2017Updated 8 years ago
- triton server ensemble model demo☆30May 2, 2022Updated 4 years ago
- A set of demo of deploying a Machine Learning Model in production using various methods☆61Sep 22, 2021Updated 4 years ago
- This demo showcase the use of onnxruntime-rs with a GPU on CUDA 11 to run Bert in a data pipeline with Rust.☆16Feb 7, 2022Updated 4 years ago
- Provide customized diffusers training and inference code for different needs☆12Jan 16, 2024Updated 2 years ago
- 基于 onnxruntime 推理引擎的中文 ltp 词法分析☆14Oct 4, 2022Updated 3 years ago
- ☆11Mar 1, 2021Updated 5 years ago
- The code for Template-GPT-2 Generation Model for Logic2Text Dataset☆18Jun 1, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- GBDT结合LR的二分类模型，封装成了一个类。scikit-learn风格，可以fit和predict。有run_demo☆11Sep 5, 2019Updated 6 years ago
- pytorch版基于gpt+nezha的中文多轮Cdial☆11Oct 22, 2022Updated 3 years ago
- ☆21Jul 20, 2022Updated 4 years ago
- The simple demo of `Unified Vision-Language Representation Modeling for E-Commerce Same-Style Products Retrieval`☆14Dec 9, 2024Updated last year
- ☆10Dec 8, 2022Updated 3 years ago
- 文本生成 - 通过商品参数和图片自动生成营销文本☆12Sep 17, 2021Updated 4 years ago
- 医院体检报告信息抽取及模板生成☆12Apr 25, 2019Updated 7 years ago
- 同花顺算法挑战平台：【9-10双月赛】跨领域迁移的文本语义匹配☆11Oct 28, 2021Updated 4 years ago
- 科大讯飞线下销量挑战赛top7方案☆13Aug 21, 2021Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Visualize feature maps in convolutional neural networks.☆12Apr 3, 2018Updated 8 years ago
- 2019CCF爱奇艺视频拷贝(版权)检测算法☆15Dec 11, 2019Updated 6 years ago
- 电商评论观点挖掘☆44Jan 29, 2021Updated 5 years ago
- English or Chinses GPT2Dialog model from GPT2-chitchat☆12Feb 23, 2020Updated 6 years ago
- ☆10Mar 23, 2020Updated 6 years ago
- 企业事件抽取☆13May 20, 2021Updated 5 years ago
- 可以将bert相关模型在网站上进行展示、测试，后端使用flask，前端使用vue。☆11Aug 20, 2021Updated 4 years ago
- ☆18Feb 22, 2022Updated 4 years ago
- Set up CI in DL/ cuda/ cudnn/ TensorRT/ onnx2trt/ onnxruntime/ onnxsim/ Pytorch/ Triton-Inference-Server/ Bazel/ Tesseract/ PaddleOCR/ NV…☆43Sep 27, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 大纪元新闻：中美关系、台湾新闻、香港新闻、中国人权、中国经济、中国政治、......☆14Nov 6, 2022Updated 3 years ago
- Controlling the MicriSpotAI robot from scratch☆14Dec 30, 2021Updated 4 years ago
- 2019搜狐第三届内容识别挑战赛rank10☆11Oct 17, 2019Updated 6 years ago
- 训练拼音转汉字模型☆10Jan 15, 2021Updated 5 years ago
- ☆12Oct 10, 2021Updated 4 years ago
- Official code repository for the WACV 2022 paper "Visualizing Paired Image Similarity in Transformer Networks"☆22Apr 13, 2022Updated 4 years ago
- ☆16Aug 17, 2021Updated 4 years ago