Alternatives and similar repositories for Serving:

Users that are interested in Serving are comparing it to the libraries listed below

• PaddlePaddle / PaddleFleetX
  飞桨大模型开发套件，提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。
  ☆460Updated 9 months ago
• PaddlePaddle / X2Paddle
  Deep learning model converter for PaddlePaddle. (『飞桨』深度学习模型转换工具)
  ☆746Updated 2 weeks ago
• PaddlePaddle / Paddle2ONNX
  ONNX Model Exporter for PaddlePaddle
  ☆772Updated last week
• PaddlePaddle / PaddleSlim
  PaddleSlim is an open-source library for deep model compression and architecture search.
  ☆1,582Updated 3 months ago
• PaddlePaddle / Paddle-Inference-Demo
  ☆252Updated last month
• PaddlePaddle / FastDeploy
  ⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio …
  ☆3,123Updated 2 weeks ago
• PaddlePaddle / docs
  Documentations for PaddlePaddle
  ☆249Updated this week
• PaddlePaddle / PLSC
  Paddle Large Scale Classification Tools，supports ArcFace, CosFace, PartialFC, Data Parallel + Model Parallel. Model includes ResNet, ViT,…
  ☆151Updated last year
• PaddlePaddle / Paddle-Lite-Demo
  lib, demo, model, data
  ☆710Updated 4 months ago
• PaddlePaddle / PGL
  Paddle Graph Learning (PGL) is an efficient and flexible graph learning framework based on PaddlePaddle
  ☆1,580Updated last year
• PaddlePaddle / PaddleX
  All-in-One Development Tool based on PaddlePaddle（飞桨低代码开发工具）
  ☆5,200Updated this week
• wuba / dl_inference
  通用深度学习推理工具，可在生产环境中快速上线由TensorFlow、PyTorch、Caffe框架训练出的深度学习模型。
  ☆410Updated 3 years ago
• frotms / PaddleOCR2Pytorch
  PaddleOCR inference in PyTorch. Converted from [PaddleOCR](https://github.com/PaddlePaddle/PaddleOCR)
  ☆918Updated 6 months ago
• AgentMaker / Paddle-Image-Models
  A PaddlePaddle version image model zoo.
  ☆118Updated 3 years ago
• PaddlePaddle / community
  PaddlePaddle Developer Community
  ☆98Updated this week
• PaddlePaddle / hapi
  hapi is a High-level API that supports both static and dynamic execution modes
  ☆75Updated 2 years ago
• PaddlePaddle / ElasticCTR
  ElasticCTR，即飞桨弹性计算推荐系统，是基于Kubernetes的企业级推荐系统开源解决方案。该方案融合了百度业务场景下持续打磨的高精度CTR模型、飞桨开源框架的大规模分布式训练能力、工业级稀疏参数弹性调度服务，帮助用户在Kubernetes环境中一键完成推荐系统部…
  ☆181Updated 4 years ago
• Tencent / TurboTransformers
  a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.
  ☆1,514Updated last year
• PaddlePaddle / models
  Officially maintained, supported by PaddlePaddle, including CV, NLP, Speech, Rec, TS, big models and so on.
  ☆6,925Updated last month
• PaddlePaddle / benchmark
  ☆78Updated last week
• PaddlePaddle / PaddleMIX
  Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pret…
  ☆517Updated this week
• PaddlePaddle / VisualDL
  Deep Learning Visualization Toolkit（『飞桨』深度学习可视化工具 ）
  ☆4,817Updated last month
• layerism / TensorRT-Inference-Server-Tutorial
  服务侧深度学习部署案例
  ☆451Updated 4 years ago
• PaddlePaddle / PaddleCustomDevice
  PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)
  ☆81Updated this week
• PaddlePaddle / VIMER
  视觉预训练基础模型仓库
  ☆497Updated last year
• PaddlePaddle / PaddleCloud
  PaddlePaddle Docker images and K8s operators for PaddleOCR/Detection developers to use on public/private cloud.
  ☆289Updated 2 years ago
• Tencent / Forward
  A library for high performance deep learning inference on NVIDIA GPUs.
  ☆552Updated 3 years ago
• alibaba / BladeDISC
  BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.
  ☆849Updated 2 months ago
• PaddlePaddle / AutoDL
  ☆158Updated 5 years ago
• WenmuZhou / PytorchOCR
  基于Pytorch的OCR工具库，支持常用的文字检测和识别算法
  ☆1,431Updated 6 months ago