Tencent / Forward
A library for high performance deep learning inference on NVIDIA GPUs.
☆549Updated 2 years ago
Related projects: ⓘ
- 服务侧深度学习部署案例☆453Updated 4 years ago
- TensorRT Plugin Autogen Tool☆365Updated last year
- Bolt is a deep learning library with high performance and heterogeneous flexibility.☆909Updated last month
- ppl.cv is a high-performance image processing library of openPPL supporting various platforms.☆488Updated 3 months ago
- A primitive library for neural network☆1,268Updated last month
- 通用深度学习推理工具,可在生产环境中快速上线由TensorFlow、PyTorch、Caffe框架训练出的深度学习模型。☆404Updated 2 years ago
- BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.☆796Updated 3 weeks ago
- ☆972Updated 6 months ago
- Deploy your model with TensorRT quickly.☆756Updated 9 months ago
- High performance Cross-platform Inference-engine, you could run Anakin on x86-cpu,arm, nv-gpu, amd-gpu,bitmain and cambricon devices.☆531Updated last year
- benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.☆202Updated 3 years ago
- Running BERT without Padding☆455Updated 2 years ago
- Simple Dynamic Batching Inference☆145Updated 2 years ago
- EasyQuant(EQ) is an efficient and simple post-training quantization method via effectively optimizing the scales of weights and activatio…☆389Updated last year
- Dive into Deep Learning Compiler☆640Updated 2 years ago
- DeepLearning Framework Performance Profiling Toolkit☆275Updated 2 years ago
- MegCC是一个运行时超轻量,高效,移植简单的深度学习模型编译器☆466Updated last month
- Use PyTorch model in C++ project☆135Updated 3 years ago
- Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.☆260Updated last year
- TVM integration into PyTorch☆452Updated 4 years ago
- row-major matmul optimization☆584Updated last year
- deepx_core是一个专注于张量计算/深度学习的基础库☆370Updated last year
- A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.☆952Updated this week
- Model Quantization Benchmark☆752Updated 3 months ago
- tensorflow源码阅读笔记☆190Updated 6 years ago
- A pytorch to tensorrt convert with dynamic shape support☆255Updated 7 months ago
- ⚡ Useful scripts when using TensorRT☆237Updated 4 years ago
- Compiler Infrastructure for Neural Networks☆142Updated last year
- ☆205Updated last year
- oneflow documentation☆68Updated 2 months ago