wuba / dl_inference

Related projects ⓘ

Alternatives and complementary repositories for dl_inference

• layerism / TensorRT-Inference-Server-Tutorial
  服务侧深度学习部署案例
  ☆453Updated 4 years ago
• Tencent / Forward
  A library for high performance deep learning inference on NVIDIA GPUs.
  ☆547Updated 2 years ago
• aliyun / algorithm-base
  让算法工程化更简单
  ☆86Updated 7 months ago
• PaddlePaddle / ElasticCTR
  ElasticCTR，即飞桨弹性计算推荐系统，是基于Kubernetes的企业级推荐系统开源解决方案。该方案融合了百度业务场景下持续打磨的高精度CTR模型、飞桨开源框架的大规模分布式训练能力、工业级稀疏参数弹性调度服务，帮助用户在Kubernetes环境中一键完成推荐系统部…
  ☆180Updated 4 years ago
• MachineLP / QDServing
  ml模型分布式服务部署：grpc，flask；docker
  ☆73Updated 3 years ago
• wuba / qa_match
  A simple effective ToolKit for short text matching
  ☆328Updated 2 years ago
• liqima / faiss_note
  faiss wiki in chinese.
  ☆428Updated 5 years ago
• BeyonderXX / tensorflow-serving-tutorial
  A tutorial of building tensorflow serving service from scratch
  ☆89Updated last year
• volcengine / veGiantModel
  ☆208Updated last year
• Oneflow-Inc / DLPerf
  DeepLearning Framework Performance Profiling Toolkit
  ☆278Updated 2 years ago
• Tencent / deepx_core
  deepx_core是一个专注于张量计算/深度学习的基础库
  ☆370Updated last year
• YellowOldOdd / SDBI
  Simple Dynamic Batching Inference
  ☆145Updated 2 years ago
• Qihoo360 / tensornet
  ☆318Updated 2 weeks ago
• gdyshi / model_deployment
  sample model deployment code
  ☆147Updated last year
• aliyun / alibabacloud-aiacc-demo
  alibabacloud-aiacc-demo
  ☆42Updated last year
• tengkz / tensorflow_notes
  tensorflow源码阅读笔记
  ☆189Updated 6 years ago
• alibaba / FastNN
  FastNN provides distributed training examples that use EPL.
  ☆81Updated 2 years ago
• zhihu / cuBERT
  Fast implementation of BERT inference directly on NVIDIA (CUDA, CUBLAS) and Intel MKL
  ☆527Updated 3 years ago
• coolhok / faiss-learning
  faiss学习总结
  ☆85Updated 5 years ago
• PaddlePaddle / Paddle-Inference-Demo
  ☆240Updated 2 weeks ago
• PaddlePaddle / PaddleFleetX
  飞桨大模型开发套件，提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。
  ☆441Updated 5 months ago
• Tlntin / ChatGLM2-6B-TensorRT
  ☆90Updated last year
• Tencent / embedx
  embedx 是基于 c++ 开发的、完全自研的分布式 embedding 训练和推理框架。它目前支持 图模型、深度排序、召回模型和图与排序、图与召回的联合训练模型等
  ☆300Updated 5 months ago
• Tencent / Lichee
  一个多模态内容理解算法框架，其中包含数据处理、预训练模型、常见模型以及模型加速等模块。
  ☆304Updated 3 years ago
• layerism / brpc_faiss_server
  Vector Search Engine base on BRPC + FAISS
  ☆147Updated 5 years ago
• Oneflow-Inc / OneFlow-Benchmark
  OneFlow models for benchmarking.
  ☆104Updated 3 months ago
• autodeployai / ai-serving
  Serving AI/ML models in the open standard formats PMML and ONNX with both HTTP (REST API) and gRPC endpoints
  ☆148Updated 2 weeks ago
• alibaba / EasyParallelLibrary
  Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
  ☆264Updated last year
• PaddlePaddle / benchmark
  ☆76Updated this week