wuba / dl_inference
通用深度学习推理工具,可在生产环境中快速上线由TensorFlow、PyTorch、Caffe框架训练出的深度学习模型。
☆410Updated 3 years ago
Alternatives and similar repositories for dl_inference:
Users that are interested in dl_inference are comparing it to the libraries listed below
- ElasticCTR,即飞桨弹性计算推荐系统,是基于Kubernetes的企业级推荐系统开源解决方案。该方案融合了百度业务场景下持续打磨的高精度CTR模型、飞桨开源框架的大规模分布式训练能力、工业级稀疏参数弹性调度服务,帮助用户在Kubernetes环境中一键完成推荐系统部…☆181Updated 4 years ago
- 服务侧深度学习部署案例☆451Updated 5 years ago
- faiss wiki in chinese.☆433Updated 5 years ago
- ml模型分布式服务部署:grpc,flask;docker☆74Updated 4 years ago
- A library for high performance deep learning inference on NVIDIA GPUs.☆552Updated 3 years ago
- A simple effective ToolKit for short text matching☆328Updated 2 years ago
- A tutorial of building tensorflow serving service from scratch☆88Updated last year
- 飞桨大模型开发套件,提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。☆466Updated 10 months ago
- faiss学习总结☆90Updated 5 years ago
- ☆323Updated last week
- 让算法工程化更简单☆85Updated last week
- ☆214Updated last year
- Serving AI/ML models in the open standard formats PMML and ONNX with both HTTP (REST API) and gRPC endpoints☆156Updated 5 months ago
- embedx 是基于 c++ 开发的、完全自研的分布式 embedding 训练和推理框架。它目前支持 图模型、深度排序、召回模型和图与排序、图与召回的联合训练模型等☆304Updated 10 months ago
- PyTorch On Angel, arming PyTorch with a powerful Parameter Server, which enable PyTorch to train very big models.☆167Updated 2 years ago
- Vector Search Engine base on BRPC + FAISS☆148Updated 5 years ago
- 一款简单好用的 跨平台/多语言的 相似向量/相似词/相似句 高性能检索引擎。欢迎star & fork。Build together! Power another !☆538Updated 2 years ago
- deepx_core是一个专注于张量计算/深度学习的基础库☆375Updated last year
- Fast implementation of BERT inference directly on NVIDIA (CUDA, CUBLAS) and Intel MKL☆543Updated 4 years ago
- A web service build on top of Facebook's Faiss☆218Updated 2 years ago
- ☆254Updated this week
- Simple Dynamic Batching Inference☆145Updated 3 years ago
- sample model deployment code☆148Updated last year
- Paddle Large Scale Classification Tools,supports ArcFace, CosFace, PartialFC, Data Parallel + Model Parallel. Model includes ResNet, ViT,…☆152Updated last year
- ☆90Updated last year
- alibabacloud-aiacc-demo☆43Updated last year
- 📚 经典技术书籍 PDF 文件,持续更新...☆48Updated 5 years ago
- A stand alone industrial serving system for angel.☆62Updated 2 years ago
- Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.☆267Updated 2 years ago
- 采用MegEngine实现的各种主流深度学习模型☆304Updated 2 years ago