huawei-noah / bolt
Bolt is a deep learning library with high performance and heterogeneous flexibility.
☆938Updated 6 months ago
Alternatives and similar repositories for bolt:
Users that are interested in bolt are comparing it to the libraries listed below
- EasyQuant(EQ) is an efficient and simple post-training quantization method via effectively optimizing the scales of weights and activatio…☆394Updated 2 years ago
- Model Quantization Benchmark☆787Updated 3 weeks ago
- A library for high performance deep learning inference on NVIDIA GPUs.☆552Updated 3 years ago
- High performance Cross-platform Inference-engine, you could run Anakin on x86-cpu,arm, nv-gpu, amd-gpu,bitmain and cambricon devices.☆532Updated 2 years ago
- benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.☆204Updated 4 years ago
- ☆1,012Updated 11 months ago
- A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.☆974Updated 5 months ago
- Quantized Neural Network PACKage - mobile-optimized implementation of quantized neural network operators☆1,535Updated 5 years ago
- ppl.cv is a high-performance image processing library of openPPL supporting various platforms.☆498Updated 3 months ago
- MNN applications by MNN, JNI exec, RK3399. Support tflite\tensorflow\caffe\onnx models.☆503Updated 5 years ago
- A primitive library for neural network☆1,310Updated 2 months ago
- TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.☆782Updated 2 months ago
- Dive into Deep Learning Compiler☆647Updated 2 years ago
- Benchmarking Neural Network Inference on Mobile Devices☆368Updated last year
- ☆665Updated 3 years ago
- Everything in Torch Fx☆341Updated 8 months ago
- Deploy your model with TensorRT quickly.☆763Updated last year
- Generate a quantization parameter file for ncnn framework int8 inference☆521Updated 4 years ago
- MegCC是一个运行时超轻量,高效,移植简单的深度学习模型编译器☆474Updated 3 months ago
- 😎 A Collection of Awesome NCNN-based Projects☆727Updated 2 years ago
- PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.☆1,620Updated 10 months ago
- TVM integration into PyTorch☆452Updated 5 years ago
- PyTorch Neural Network eXchange☆556Updated 3 weeks ago
- 服务侧深度学习部署案例☆451Updated 4 years ago
- micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantiz…☆2,228Updated 3 years ago
- TensorRT Plugin Autogen Tool☆369Updated last year
- A parser, editor and profiler tool for ONNX models.☆414Updated last month
- BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.☆844Updated last month
- pytorch to caffe by onnx☆371Updated 5 years ago
- row-major matmul optimization☆602Updated last year