Alternatives and similar repositories for Serving

Users that are interested in Serving are comparing it to the libraries listed below

• PaddlePaddle / PaddleFleetX
  飞桨大模型开发套件，提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。
  ☆465Updated 11 months ago
• PaddlePaddle / X2Paddle
  Deep learning model converter for PaddlePaddle. (『飞桨』深度学习模型转换工具)
  ☆754Updated 2 months ago
• PaddlePaddle / Paddle2ONNX
  ONNX Model Exporter for PaddlePaddle
  ☆804Updated last week
• PaddlePaddle / PaddleSlim
  PaddleSlim is an open-source library for deep model compression and architecture search.
  ☆1,590Updated 5 months ago
• PaddlePaddle / Paddle-Inference-Demo
  ☆258Updated this week
• PaddlePaddle / hapi
  hapi is a High-level API that supports both static and dynamic execution modes
  ☆75Updated 2 years ago
• PaddlePaddle / docs
  Documentations for PaddlePaddle
  ☆259Updated this week
• PaddlePaddle / PLSC
  Paddle Large Scale Classification Tools，supports ArcFace, CosFace, PartialFC, Data Parallel + Model Parallel. Model includes ResNet, ViT,…
  ☆152Updated last year
• PaddlePaddle / community
  PaddlePaddle Developer Community
  ☆108Updated this week
• wuba / dl_inference
  通用深度学习推理工具，可在生产环境中快速上线由TensorFlow、PyTorch、Caffe框架训练出的深度学习模型。
  ☆411Updated 3 years ago
• PaddlePaddle / benchmark
  ☆78Updated last month
• PaddlePaddle / Paddle-Lite-Demo
  lib, demo, model, data
  ☆731Updated 6 months ago
• PaddlePaddle / PaddleCloud
  PaddlePaddle Docker images and K8s operators for PaddleOCR/Detection developers to use on public/private cloud.
  ☆292Updated 2 years ago
• AgentMaker / Paddle-Image-Models
  A PaddlePaddle version image model zoo.
  ☆117Updated 3 years ago
• PaddlePaddle / PaddleCustomDevice
  PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)
  ☆83Updated last week
• PaddlePaddle / PaddleRec
  Recommendation Algorithm大规模推荐算法库，包含推荐系统经典及最新算法LR、Wide&Deep、DSSM、TDM、MIND、Word2Vec、Bert4Rec、DeepWalk、SSR、AITM，DSIN，SIGN，IPREC、GRU4Rec、Yout…
  ☆3,939Updated last month
• Tencent / TurboTransformers
  a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.
  ☆1,521Updated last month
• PaddlePaddle / Knover
  Large-scale open domain KNOwledge grounded conVERsation system based on PaddlePaddle
  ☆672Updated last year
• yeyupiaoling / LearnPaddle2
  PaddlePaddle Fluid 版本系列教程，CSDN博客专栏：
  ☆158Updated 4 years ago
• PaddlePaddle / ElasticCTR
  ElasticCTR，即飞桨弹性计算推荐系统，是基于Kubernetes的企业级推荐系统开源解决方案。该方案融合了百度业务场景下持续打磨的高精度CTR模型、飞桨开源框架的大规模分布式训练能力、工业级稀疏参数弹性调度服务，帮助用户在Kubernetes环境中一键完成推荐系统部…
  ☆183Updated 4 years ago
• Adlik / Adlik
  Adlik: Toolkit for Accelerating Deep Learning Inference
  ☆798Updated last year
• DeepRec-AI / DeepRec
  DeepRec is a high-performance recommendation deep learning framework based on TensorFlow. It is hosted in incubation in LF AI & Data Foun…
  ☆1,099Updated 3 months ago
• alibaba / BladeDISC
  BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.
  ☆863Updated 4 months ago
• PaddlePaddle / PaddleYOLO
  🚀🚀🚀 YOLO series of PaddlePaddle implementation, PP-YOLOE+, RT-DETR, YOLOv5, YOLOv6, YOLOv7, YOLOv8, YOLOv10, YOLO11, YOLOX, YOLOv5u, Y…
  ☆600Updated 2 months ago
• huawei-noah / bolt
  Bolt is a deep learning library with high performance and heterogeneous flexibility.
  ☆943Updated last month
• Tencent / Forward
  A library for high performance deep learning inference on NVIDIA GPUs.
  ☆552Updated 3 years ago
• Tencent / deepx_core
  deepx_core是一个专注于张量计算/深度学习的基础库
  ☆375Updated 3 weeks ago
• AI-Rank / AI-Rank
  面向产业应用的AI开源评测基准
  ☆11Updated 2 years ago
• PaddleCV-SIG / PaddleLabel
  飞桨智能标注，让标注快人一步
  ☆274Updated 5 months ago
• layerism / TensorRT-Inference-Server-Tutorial
  服务侧深度学习部署案例
  ☆451Updated 5 years ago