Alternatives and similar repositories for Forward:

Users that are interested in Forward are comparing it to the libraries listed below

• layerism / TensorRT-Inference-Server-Tutorial
  服务侧深度学习部署案例
  ☆451Updated 4 years ago
• Tencent / TPAT
  TensorRT Plugin Autogen Tool
  ☆369Updated last year
• OpenPPL / ppl.cv
  ppl.cv is a high-performance image processing library of openPPL supporting various platforms.
  ☆500Updated 4 months ago
• OpenPPL / ppl.nn
  A primitive library for neural network
  ☆1,324Updated 3 months ago
• zerollzeng / tiny-tensorrt
  Deploy your model with TensorRT quickly.
  ☆765Updated last year
• LitLeo / TensorRT_Tutorial
  ☆1,017Updated last year
• AI-performance / embedded-ai.bench
  benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.
  ☆203Updated 4 years ago
• huawei-noah / bolt
  Bolt is a deep learning library with high performance and heterogeneous flexibility.
  ☆940Updated 7 months ago
• alibaba / BladeDISC
  BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.
  ☆850Updated 2 months ago
• DeepVAC / libdeepvac
  Use PyTorch model in C++ project
  ☆137Updated 3 years ago
• MegEngine / MegCC
  MegCC是一个运行时超轻量，高效，移植简单的深度学习模型编译器
  ☆480Updated 4 months ago
• YellowOldOdd / SDBI
  Simple Dynamic Batching Inference
  ☆145Updated 3 years ago
• Oneflow-Inc / DLPerf
  DeepLearning Framework Performance Profiling Toolkit
  ☆285Updated 2 years ago
• deepglint / EasyQuant
  EasyQuant(EQ) is an efficient and simple post-training quantization method via effectively optimizing the scales of weights and activatio…
  ☆394Updated 2 years ago
• d2l-ai / d2l-tvm
  Dive into Deep Learning Compiler
  ☆647Updated 2 years ago
• PaddlePaddle / Anakin
  High performance Cross-platform Inference-engine, you could run Anakin on x86-cpu,arm, nv-gpu, amd-gpu,bitmain and cambricon devices.
  ☆533Updated 2 years ago
• ModelTC / MQBench
  Model Quantization Benchmark
  ☆792Updated 2 months ago
• grimoire / torch2trt_dynamic
  A pytorch to tensorrt convert with dynamic shape support
  ☆258Updated last year
• wuba / dl_inference
  通用深度学习推理工具，可在生产环境中快速上线由TensorFlow、PyTorch、Caffe框架训练出的深度学习模型。
  ☆410Updated 3 years ago
• Syencil / tensorRT
  TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据
  ☆527Updated 3 years ago
• rmccorm4 / tensorrt-utils
  ⚡ Useful scripts when using TensorRT
  ☆242Updated 4 years ago
• microsoft / nnfusion
  A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.
  ☆979Updated 6 months ago
• tpoisonooo / how-to-optimize-gemm
  row-major matmul optimization
  ☆610Updated last year
• Tencent / deepx_core
  deepx_core是一个专注于张量计算/深度学习的基础库
  ☆374Updated last year
• torchpipe / torchpipe
  Serving Inside Pytorch
  ☆156Updated this week
• NVIDIA / trt-samples-for-hackathon-cn
  Simple samples for TensorRT programming
  ☆1,586Updated last week
• RizhaoCai / PyTorch_ONNX_TensorRT
  A tutorial about how to build a TensorRT Engine from a PyTorch Model with the help of ONNX
  ☆243Updated 4 years ago
• HeKun-NVIDIA / TensorRT-Developer_Guide_in_Chinese
  ☆266Updated 2 years ago
• bytedance / ByteTransformer
  optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052
  ☆471Updated last year
• tengkz / tensorflow_notes
  tensorflow源码阅读笔记
  ☆190Updated 6 years ago