Alternatives and similar repositories for bolt

Users that are interested in bolt are comparing it to the libraries listed below

• Tencent / Forward
  A library for high performance deep learning inference on NVIDIA GPUs.
  ☆557Updated 3 years ago
• OpenPPL / ppl.nn
  A primitive library for neural network
  ☆1,369Updated last year
• deepglint / EasyQuant
  EasyQuant(EQ) is an efficient and simple post-training quantization method via effectively optimizing the scales of weights and activatio…
  ☆405Updated 3 years ago
• PaddlePaddle / Anakin
  High performance Cross-platform Inference-engine, you could run Anakin on x86-cpu,arm, nv-gpu, amd-gpu,bitmain and cambricon devices.
  ☆535Updated 3 years ago
• AI-performance / embedded-ai.bench
  benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.
  ☆203Updated 4 years ago
• alibaba / TinyNeuralNetwork
  TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.
  ☆862Updated 2 weeks ago
• ModelTC / MQBench
  Model Quantization Benchmark
  ☆855Updated 8 months ago
• LitLeo / TensorRT_Tutorial
  ☆1,045Updated last year
• OpenPPL / ppl.cv
  ppl.cv is a high-performance image processing library of openPPL supporting various platforms.
  ☆514Updated last year
• pytorch / QNNPACK
  Quantized Neural Network PACKage - mobile-optimized implementation of quantized neural network operators
  ☆1,551Updated 6 years ago
• microsoft / nnfusion
  A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.
  ☆1,004Updated last year
• Adlik / Adlik
  Adlik: Toolkit for Accelerating Deep Learning Inference
  ☆810Updated 2 years ago
• alibaba / BladeDISC
  BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.
  ☆912Updated last year
• zerollzeng / tiny-tensorrt
  Deploy your model with TensorRT quickly.
  ☆765Updated 2 years ago
• inisis / brocolli
  Everything in Torch Fx
  ☆345Updated last year
• XiaoMi / mobile-ai-bench
  Benchmarking Neural Network Inference on Mobile Devices
  ☆384Updated 2 years ago
• Tencent / TPAT
  TensorRT Plugin Autogen Tool
  ☆367Updated 2 years ago
• xindongzhang / MNN-APPLICATIONS
  MNN applications by MNN, JNI exec, RK3399. Support tflite\tensorflow\caffe\onnx models.
  ☆509Updated 6 years ago
• MegEngine / MegCC
  MegCC是一个运行时超轻量，高效，移植简单的深度学习模型编译器
  ☆489Updated last year
• 666DZY666 / micronet
  micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantiz…
  ☆2,271Updated 8 months ago
• d2l-ai / d2l-tvm
  Dive into Deep Learning Compiler
  ☆645Updated 3 years ago
• ThanatosShinji / onnx-tool
  A parser, editor and profiler tool for ONNX models.
  ☆471Updated 2 months ago
• Tencent / FeatherCNN
  FeatherCNN is a high performance inference engine for convolutional neural networks.
  ☆1,225Updated 6 years ago
• memoiry / Awesome-model-compression-and-acceleration
  ☆670Updated 4 years ago
• pytorch / tvm
  TVM integration into PyTorch
  ☆456Updated 5 years ago
• BUG1989 / caffe-int8-convert-tools
  Generate a quantization parameter file for ncnn framework int8 inference
  ☆518Updated 5 years ago
• Tencent / TurboTransformers
  a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.
  ☆1,536Updated 5 months ago
• tpoisonooo / how-to-optimize-gemm
  row-major matmul optimization
  ☆696Updated 4 months ago
• layerism / TensorRT-Inference-Server-Tutorial
  服务侧深度学习部署案例
  ☆455Updated 5 years ago
• Jermmy / pytorch-quantization-demo
  A simple network quantization demo using pytorch from scratch.
  ☆541Updated 2 years ago