通用深度学习推理工具，可在生产环境中快速上线由TensorFlow、PyTorch、Caffe框架训练出的深度学习模型。
☆416Dec 21, 2021Updated 4 years ago
Alternatives and similar repositories for dl_inference
Users that are interested in dl_inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A simple effective ToolKit for short text matching☆327Jul 19, 2022Updated 4 years ago
- ml模型分布式服务部署：grpc，flask；docker☆77Jan 5, 2021Updated 5 years ago
- Boosting your Web Services of Deep Learning Applications.☆1,241May 13, 2021Updated 5 years ago
- 服务侧深度学习部署案例☆455Mar 27, 2020Updated 6 years ago
- A flexible, high-performance serving system for machine learning models☆144Nov 24, 2021Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据☆535Jul 17, 2021Updated 5 years ago
- Deep Match to Rank Model for Personalized Click-Through Rate Prediction☆236Feb 6, 2020Updated 6 years ago
- lightweighted deep learning inference service framework☆38Jun 19, 2021Updated 5 years ago
- 复盘所有NLP比赛的TOP方案，只关注NLP比赛，持续更新中！☆2,806Apr 4, 2026Updated 5 months ago
- LightSeq: A High Performance Library for Sequence Processing and Generation☆3,294May 16, 2023Updated 3 years ago
- 自动机器学习训练平台☆11Sep 3, 2020Updated 6 years ago
- ☆52May 21, 2021Updated 5 years ago
- a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.☆1,551Jul 18, 2025Updated last year
- JPMML-SparkML plugin for converting LightGBM-Spark models to PMML☆44Oct 23, 2021Updated 4 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆11,002Updated this week
- A library for high performance deep learning inference on NVIDIA GPUs.☆557Jan 29, 2022Updated 4 years ago
- A high performance and generic framework for distributed DNN training☆3,716Oct 3, 2023Updated 2 years ago
- Vector Search Engine base on BRPC + FAISS☆151Oct 21, 2019Updated 6 years ago
- Open Language Pre-trained Model Zoo☆1,003Nov 18, 2021Updated 4 years ago
- 主要是我是日常看过的不错的文章的资源汇总，方便自己也分享给大家。有些我看过的，就会做简单的解读，没看过的，就先罗列一下，然后之后看了把解读更新上；涉及到搜索/推荐/自然语言处理。☆1,759Jun 3, 2021Updated 5 years ago
- C++ model train&inference framework☆222Dec 25, 2019Updated 6 years ago
- a bert for retrieval and generation☆860Feb 26, 2021Updated 5 years ago
- pycorrector is a toolkit for text error correction. 文本纠错，实现了Kenlm，T5，MacBERT，ChatGLM3，Qwen2.5等模型应用在纠错场景，开箱即用。☆6,526Jul 25, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A deep matching model library for recommendations & advertising. It's easy to train models and to export representation vectors which can…☆2,435Apr 18, 2026Updated 5 months ago
- Serve, optimize and scale PyTorch models in production☆4,344Aug 6, 2025Updated last year
- keras implement of transformers for humans☆5,411Nov 11, 2024Updated last year
- A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型☆3,983Nov 21, 2022Updated 3 years ago
- TensorFlow Serving API of all programming language supported by protobuf and grpc.☆27Oct 16, 2020Updated 5 years ago
- ccf 2020 qa match competition top1☆264Jan 28, 2021Updated 5 years ago
- Deploy your model with TensorRT quickly.☆763Nov 21, 2023Updated 2 years ago
- The score code of FastBERT (ACL2020)☆606Oct 29, 2021Updated 4 years ago
- TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is …☆4,652May 9, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 利用语言模型，纠正OCR识别错误☆477May 22, 2023Updated 3 years ago
- 高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型☆811Jul 8, 2020Updated 6 years ago
- 基于 Tensorflow，仿 Scikit-Learn 设计的深度学习自然语言处理框架。支持 40 余种模型类，涵盖语言模型、文本分类、NER、MRC、知识蒸馏等各个领域☆116May 10, 2023Updated 3 years ago
- Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.☆3,167Jan 22, 2024Updated 2 years ago
- PyTorch On Angel, arming PyTorch with a powerful Parameter Server, which enable PyTorch to train very big models.☆173Sep 10, 2026Updated last week
- EasyTransfer is designed to make the development of transfer learning in NLP applications easier.☆861Aug 25, 2022Updated 4 years ago
- Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard☆1,783Feb 18, 2023Updated 3 years ago