Tencent / ForwardLinks
A library for high performance deep learning inference on NVIDIA GPUs.
☆553Updated 3 years ago
Alternatives and similar repositories for Forward
Users that are interested in Forward are comparing it to the libraries listed below
Sorting:
- 服务侧深度学习部署案例☆451Updated 5 years ago
- TensorRT Plugin Autogen Tool☆369Updated 2 years ago
- ppl.cv is a high-performance image processing library of openPPL supporting various platforms.☆504Updated 7 months ago
- Bolt is a deep learning library with high performance and heterogeneous flexibility.☆950Updated 2 months ago
- ☆1,033Updated last year
- Deploy your model with TensorRT quickly.☆768Updated last year
- benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.☆204Updated 4 years ago
- A primitive library for neural network☆1,345Updated 6 months ago
- High performance Cross-platform Inference-engine, you could run Anakin on x86-cpu,arm, nv-gpu, amd-gpu,bitmain and cambricon devices.☆533Updated 2 years ago
- DeepLearning Framework Performance Profiling Toolkit☆285Updated 3 years ago
- Simple Dynamic Batching Inference☆145Updated 3 years ago
- 通用深度学习推理工具,可在生产环境中快速上线由TensorFlow、PyTorch、Caffe框架训练出的深度学习模型。☆410Updated 3 years ago
- MegCC是一个运行时超轻量,高效,移植简单的深度学习模型编译器☆485Updated 7 months ago
- EasyQuant(EQ) is an efficient and simple post-training quantization method via effectively optimizing the scales of weights and activatio…☆400Updated 2 years ago
- Use PyTorch model in C++ project☆139Updated 3 years ago
- BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.☆873Updated 5 months ago
- ⚡ Useful scripts when using TensorRT☆242Updated 4 years ago
- Dive into Deep Learning Compiler☆644Updated 3 years ago
- deepx_core是一个专注于张量计算/深度学习的基础库☆377Updated 2 months ago
- tensorflow源码阅读笔记☆191Updated 6 years ago
- Running BERT without Padding☆471Updated 3 years ago
- ☆127Updated 3 years ago
- OneFlow models for benchmarking.☆104Updated 10 months ago
- row-major matmul optimization☆637Updated last year
- A tutorial about how to build a TensorRT Engine from a PyTorch Model with the help of ONNX☆247Updated 4 years ago
- Model Quantization Benchmark☆814Updated 2 months ago
- optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052☆474Updated last year
- Serving Inside Pytorch☆160Updated 2 weeks ago
- A pytorch to tensorrt convert with dynamic shape support☆260Updated last year
- ☆99Updated 3 years ago