Alternatives and similar repositories for dl_inference

Users that are interested in dl_inference are comparing it to the libraries listed below

• layerism / TensorRT-Inference-Server-Tutorial
  服务侧深度学习部署案例
  ☆454Updated 5 years ago
• liqima / faiss_note
  faiss wiki in chinese.
  ☆442Updated 6 years ago
• MachineLP / QDServing
  ml模型分布式服务部署：grpc，flask；docker
  ☆76Updated 4 years ago
• Tencent / Forward
  A library for high performance deep learning inference on NVIDIA GPUs.
  ☆557Updated 3 years ago
• aliyun / algorithm-base
  让算法工程化更简单
  ☆94Updated 7 months ago
• gdyshi / model_deployment
  sample model deployment code
  ☆149Updated 2 years ago
• ChunelFeng / caiss
  一款简单好用的 跨平台/多语言的 相似向量/相似词/相似句 高性能检索引擎。欢迎star & fork。Build together! Power another !
  ☆547Updated 2 years ago
• coolhok / faiss-learning
  faiss学习总结
  ☆96Updated 6 years ago
• BeyonderXX / tensorflow-serving-tutorial
  A tutorial of building tensorflow serving service from scratch
  ☆89Updated 2 years ago
• PaddlePaddle / ElasticCTR
  ElasticCTR，即飞桨弹性计算推荐系统，是基于Kubernetes的企业级推荐系统开源解决方案。该方案融合了百度业务场景下持续打磨的高精度CTR模型、飞桨开源框架的大规模分布式训练能力、工业级稀疏参数弹性调度服务，帮助用户在Kubernetes环境中一键完成推荐系统部…
  ☆186Updated 5 years ago
• layerism / brpc_faiss_server
  Vector Search Engine base on BRPC + FAISS
  ☆150Updated 6 years ago
• mogoweb / aiexamples
  some examples of AI
  ☆89Updated 6 years ago
• aianaconda / TensorFlow_Engineering_Implementation
  The source code and dataset about <Deep Learning - Best Practices on TensorFlow Engineering Implementation>
  ☆217Updated 4 years ago
• alibaba / FastNN
  FastNN provides distributed training examples that use EPL.
  ☆84Updated 3 years ago
• wuba / qa_match
  A simple effective ToolKit for short text matching
  ☆328Updated 3 years ago
• aipredict / ai-models-serialization
  AI模型序列化总结
  ☆52Updated 5 years ago
• fancyerii / blog-codes
  个人博客 (https://fancyerii.github.io/) 文章的代码
  ☆185Updated last year
• autodeployai / ai-serving
  Serving AI/ML models in the open standard formats PMML and ONNX with both HTTP (REST API) and gRPC endpoints
  ☆163Updated last year
• YellowOldOdd / SDBI
  Simple Dynamic Batching Inference
  ☆145Updated 3 years ago
• Angel-ML / PyTorch-On-Angel
  PyTorch On Angel, arming PyTorch with a powerful Parameter Server, which enable PyTorch to train very big models.
  ☆168Updated 2 weeks ago
• Tencent / Lichee
  一个多模态内容理解算法框架，其中包含数据处理、预训练模型、常见模型以及模型加速等模块。
  ☆321Updated 4 years ago
• Tencent / deepx_core
  deepx_core是一个专注于张量计算/深度学习的基础库
  ☆381Updated 6 months ago
• DjangoPeng / tensorflow-in-depth
  《深入理解TensorFlow》项目代码与样章
  ☆311Updated 5 years ago
• iqiyi / xgboost-serving
  A flexible, high-performance serving system for machine learning models
  ☆144Updated 3 years ago
• huxiaoman7 / PaddleAI
  用PaddlePaddle实现的真实案例和有趣应用
  ☆25Updated 6 years ago
• PaddlePaddle / PaddleFleetX
  飞桨大模型开发套件，提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。
  ☆474Updated last year
• minitrill / TextAudit
  一个短视频app文本审核模块的实现思路及demo
  ☆122Updated 7 years ago
• tensorlayer / text-antispam
  商用级垃圾文本分类器
  ☆415Updated 3 years ago
• waltyou / faiss-web-service
  A web service build on top of Facebook's Faiss
  ☆93Updated 4 years ago
• FlYWMe / SearchServer
  一个基于 faiss 的检索服务.
  ☆49Updated 7 years ago