OpenPPL / ppl.cv

Related projects: ⓘ

• OpenPPL / ppl.nn
  A primitive library for neural network
  ☆1,268Updated last month
• tpoisonooo / how-to-optimize-gemm
  row-major matmul optimization
  ☆584Updated last year
• Tencent / TPAT
  TensorRT Plugin Autogen Tool
  ☆365Updated last year
• MegEngine / MegCC
  MegCC是一个运行时超轻量，高效，移植简单的深度学习模型编译器
  ☆466Updated last month
• LitLeo / TensorRT_Tutorial
  ☆972Updated 6 months ago
• HeKun-NVIDIA / TensorRT-Developer_Guide_in_Chinese
  ☆212Updated 2 years ago
• nndeploy / nndeploy
  nndeploy是一款模型端到端部署框架。以多端推理以及基于有向无环图模型部署为基础，致力为用户提供跨平台、简单易用、高性能的模型部署体验。
  ☆600Updated this week
• zerollzeng / tiny-tensorrt
  Deploy your model with TensorRT quickly.
  ☆756Updated 9 months ago
• ThanatosShinji / onnx-tool
  A parser, editor and profiler tool for ONNX models.
  ☆379Updated 3 weeks ago
• AI-performance / embedded-ai.bench
  benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.
  ☆202Updated 3 years ago
• Yinghan-Li / YHs_Sample
  Yinghan's Code Sample
  ☆272Updated 2 years ago
• ModelTC / MQBench
  Model Quantization Benchmark
  ☆752Updated 3 months ago
• deepglint / EasyQuant
  EasyQuant(EQ) is an efficient and simple post-training quantization method via effectively optimizing the scales of weights and activatio…
  ☆389Updated last year
• pnnx / pnnx
  PyTorch Neural Network eXchange
  ☆490Updated this week
• NVIDIA-AI-IOT / tensorrt_plugin_generator
  A simple tool that can generate TensorRT plugin code quickly.
  ☆216Updated last year
• Cjkkkk / CUDA_gemm
  A simple high performance CUDA GEMM implementation.
  ☆319Updated 8 months ago
• Cambricon / CNStream
  CNStream is a streaming framework for building Cambricon machine learning pipelines http://forum.cambricon.com https://gitee.com/Solu…
  ☆44Updated last year
• torchpipe / torchpipe
  Serving Inside Pytorch
  ☆140Updated last week
• alibaba / BladeDISC
  BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.
  ☆796Updated 3 weeks ago
• yzhaiustc / Optimizing-SGEMM-on-NVIDIA-Turing-GPUs
  Optimizing SGEMM kernel functions on NVIDIA GPUs to a close-to-cuBLAS performance.
  ☆265Updated 2 years ago
• sophgo / tpu-mlir
  Machine learning compiler based on MLIR for Sophgo TPU.
  ☆576Updated last month
• Tencent / Forward
  A library for high performance deep learning inference on NVIDIA GPUs.
  ☆549Updated 2 years ago
• LitLeo / OpenCUDA
  ☆254Updated 6 years ago
• OpenPPL / ppq
  PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.
  ☆1,511Updated 5 months ago
• aovoc / nnieqat-pytorch
  A nnie quantization aware training tool on pytorch.
  ☆238Updated 3 years ago
• BBuf / how-to-optimize-gemm
  ☆92Updated 3 years ago
• Cambricon / mlu-ops
  Efficient operation implementation based on the Cambricon Machine Learning Unit (MLU) .
  ☆100Updated this week
• pigirons / cpufp
  A CPU tool for benchmarking the peak of floating points
  ☆472Updated this week
• inisis / brocolli
  Everything in Torch Fx
  ☆335Updated 3 months ago