Using TensorRT and Triton Server to build BERT model as a service
☆13Jan 10, 2022Updated 4 years ago
Alternatives and similar repositories for faster-bert-as-service
Users that are interested in faster-bert-as-service are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TensorRT☆11Sep 22, 2020Updated 6 years ago
- 针对NER领域提供从线下训练到线上部署的一整套闭环流程☆14Jun 16, 2021Updated 5 years ago
- Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> O…☆33Aug 18, 2021Updated 5 years ago
- Tutorial from @rwieruch's Road to Learn React☆14Sep 2, 2018Updated 8 years ago
- Magface Triton Inferece Server Using Tensorrt☆19Feb 12, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Convert BART models to ONNX with quantization. 3X reduction in size, and upto 3X boost in inference speed☆33Dec 11, 2024Updated last year
- Algorithms from paper: Evaluation of Session-based Recommendation Algorithms☆16Nov 8, 2018Updated 8 years ago
- CHIP2021医学对话临床发现阴阳性判别任务冠军方案☆17Mar 11, 2022Updated 4 years ago
- Non Metric Space ( Approximate ) Library in R☆12Feb 2, 2023Updated 3 years ago
- MXNet Model Serving☆25Oct 4, 2017Updated 9 years ago
- Sara - the Rasa Demo Bot: An example of a contextual AI assistant built with the open source Rasa Stack☆11Jan 14, 2021Updated 5 years ago
- triton server ensemble model demo☆30May 2, 2022Updated 4 years ago
- 基于 onnxruntime 推理引擎的中文 ltp 词法分析☆14Oct 4, 2022Updated 4 years ago
- One Repository of AI Series: Collecting the useful technology articles, opensource tutorials and opensource books. 我的AI系列仓库之一:收集有用的技术文章、开…☆10Nov 14, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The code for Template-GPT-2 Generation Model for Logic2Text Dataset☆18Jun 1, 2020Updated 6 years ago
- LawVM compiles human-written amendment acts into auditable point-in-time legal text-state. It treats legislation as executable state tran…☆14Jul 12, 2026Updated 4 months ago
- Provide customized diffusers training and inference code for different needs☆12Jan 16, 2024Updated 2 years ago
- 同花顺算法挑战平台:【9-10双月赛】跨领域迁移的文本语义匹配☆11Oct 28, 2021Updated 5 years ago
- Text Classification using 15 Deep Learning Models with both Multi-Label and Single-Label Task.☆12Mar 12, 2020Updated 6 years ago
- English or Chinses GPT2Dialog model from GPT2-chitchat☆12Feb 23, 2020Updated 6 years ago
- NLP提取美团美食评论的标签☆10May 11, 2020Updated 6 years ago
- 这是一个快速搭建NLP、CV、推荐、广告等DL方向的手脚架,包括基本的分类、回归、聚类、序列标注、双塔、seq2seq等常见模型的简洁实现。☆10May 23, 2020Updated 6 years ago
- 可以将bert相关模型在网站上进行展示、测试,后端使用flask,前端使用vue。☆11Aug 20, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 根据维基百科历史编辑数据提取纠错语料。☆12Apr 6, 2022Updated 4 years ago
- 电商评论观点挖掘☆46Jan 29, 2021Updated 5 years ago
- Visualize feature maps in convolutional neural networks.☆12Apr 3, 2018Updated 8 years ago
- 企业事件抽取☆13May 20, 2021Updated 5 years ago
- The simple demo of `Unified Vision-Language Representation Modeling for E-Commerce Same-Style Products Retrieval`☆14Dec 9, 2024Updated last year
- ☆10Mar 23, 2020Updated 6 years ago
- 训练拼音转汉字模型☆10Jan 15, 2021Updated 5 years ago
- ☆14Updated this week
- 中文事件抽取☆11Feb 26, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 本项目使用Keras实现R-BERT,在人物关系数据集上进行测试验证。☆10Apr 17, 2021Updated 5 years ago
- 基于wide deep模型的CTR预估,从训练到部署☆18Jun 24, 2019Updated 7 years ago
- ☆12Jul 14, 2021Updated 5 years ago
- CCKS 2022 通用信息抽取☆13May 1, 2022Updated 4 years ago
- Set up CI in DL/ cuda/ cudnn/ TensorRT/ onnx2trt/ onnxruntime/ onnxsim/ Pytorch/ Triton-Inference-Server/ Bazel/ Tesseract/ PaddleOCR/ NV…☆43Sep 27, 2023Updated 3 years ago
- Chinese Grammatical Error Diagnosis☆11Oct 26, 2021Updated 5 years ago
- 全球人工智能技术创新大赛-赛道三:小布助手对话短文本语义匹配☆11Apr 5, 2021Updated 5 years ago
Are these results useful?