Tencent / ForwardLinks
A library for high performance deep learning inference on NVIDIA GPUs.
☆552Updated 3 years ago
Alternatives and similar repositories for Forward
Users that are interested in Forward are comparing it to the libraries listed below
Sorting:
- 服务侧深度学习部署案例☆451Updated 5 years ago
- TensorRT Plugin Autogen Tool☆369Updated 2 years ago
- ppl.cv is a high-performance image processing library of openPPL supporting various platforms.☆503Updated 7 months ago
- Deploy your model with TensorRT quickly.☆768Updated last year
- ☆1,026Updated last year
- A primitive library for neural network☆1,343Updated 6 months ago
- MegCC是一个运行时超轻量,高效,移植简单的深度学习模型编译器☆485Updated 7 months ago
- High performance Cross-platform Inference-engine, you could run Anakin on x86-cpu,arm, nv-gpu, amd-gpu,bitmain and cambricon devices.☆533Updated 2 years ago
- Bolt is a deep learning library with high performance and heterogeneous flexibility.☆947Updated last month
- DeepLearning Framework Performance Profiling Toolkit☆285Updated 3 years ago
- BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.☆871Updated 5 months ago
- Simple Dynamic Batching Inference☆145Updated 3 years ago
- Use PyTorch model in C++ project☆139Updated 3 years ago
- row-major matmul optimization☆634Updated last year
- 通用深度学习推理工具,可在生产环境中快速上线由TensorFlow、PyTorch、Caffe框架训练出的深度学习模型。☆410Updated 3 years ago
- Running BERT without Padding☆471Updated 3 years ago
- benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.☆204Updated 4 years ago
- EasyQuant(EQ) is an efficient and simple post-training quantization method via effectively optimizing the scales of weights and activatio…☆400Updated 2 years ago
- Dive into Deep Learning Compiler☆645Updated 2 years ago
- Compiler Infrastructure for Neural Networks☆145Updated last year
- TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据☆528Updated 3 years ago
- CNStream is a streaming framework for building Cambricon machine learning pipelines http://forum.cambricon.com https://gitee.com/Solu…☆51Updated 2 months ago
- Fast implementation of BERT inference directly on NVIDIA (CUDA, CUBLAS) and Intel MKL☆544Updated 4 years ago
- ⚡ Useful scripts when using TensorRT☆242Updated 4 years ago
- A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.☆986Updated 8 months ago
- Model Quantization Benchmark☆806Updated last month
- A pytorch to tensorrt convert with dynamic shape support☆261Updated last year
- tensorflow源码阅读笔记☆191Updated 6 years ago
- deepx_core是一个专注于张量计算/深度学习的基础库☆376Updated last month
- thor: C++ helper library, for deep learning purpose☆277Updated 2 years ago