huawei-noah / boltLinks
Bolt is a deep learning library with high performance and heterogeneous flexibility.
☆954Updated 4 months ago
Alternatives and similar repositories for bolt
Users that are interested in bolt are comparing it to the libraries listed below
Sorting:
- A library for high performance deep learning inference on NVIDIA GPUs.☆558Updated 3 years ago
- A primitive library for neural network☆1,349Updated 8 months ago
- EasyQuant(EQ) is an efficient and simple post-training quantization method via effectively optimizing the scales of weights and activatio…☆402Updated 2 years ago
- High performance Cross-platform Inference-engine, you could run Anakin on x86-cpu,arm, nv-gpu, amd-gpu,bitmain and cambricon devices.☆533Updated 2 years ago
- ppl.cv is a high-performance image processing library of openPPL supporting various platforms.☆509Updated 9 months ago
- benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.☆204Updated 4 years ago
- Quantized Neural Network PACKage - mobile-optimized implementation of quantized neural network operators☆1,543Updated 5 years ago
- A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.☆993Updated 11 months ago
- Adlik: Toolkit for Accelerating Deep Learning Inference☆805Updated last year
- Dive into Deep Learning Compiler☆646Updated 3 years ago
- BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.☆886Updated 7 months ago
- MegCC是一个运行时超轻量,高效,移植简单的深度学习模型编译器☆487Updated 9 months ago
- ☆1,035Updated last year
- Benchmarking Neural Network Inference on Mobile Devices☆380Updated 2 years ago
- Model Quantization Benchmark☆828Updated 4 months ago
- Everything in Torch Fx☆344Updated last year
- FeatherCNN is a high performance inference engine for convolutional neural networks.☆1,218Updated 5 years ago
- TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.☆842Updated this week
- TVM integration into PyTorch☆453Updated 5 years ago
- TensorRT Plugin Autogen Tool☆367Updated 2 years ago
- row-major matmul optimization☆653Updated last year
- a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.☆1,530Updated last month
- MNN applications by MNN, JNI exec, RK3399. Support tflite\tensorflow\caffe\onnx models.☆508Updated 5 years ago
- heterogeneity-aware-lowering-and-optimization☆256Updated last year
- A parser, editor and profiler tool for ONNX models.☆450Updated 2 weeks ago
- Deploy your model with TensorRT quickly.☆769Updated last year
- Generate a quantization parameter file for ncnn framework int8 inference☆518Updated 5 years ago
- 😎 A Collection of Awesome NCNN-based Projects☆743Updated 2 years ago
- ONNX Optimizer☆742Updated 2 weeks ago
- 服务侧深度学习部署案例☆454Updated 5 years ago