Alternatives and similar repositories for jedi:

Users that are interested in jedi are comparing it to the libraries listed below

• NVIDIA / sampleQAT
  Inference of quantization aware trained networks using TensorRT
  ☆80Updated 2 years ago
• NVIDIA-AI-IOT / jetson_dla_tutorial
  A tutorial for getting started with the Deep Learning Accelerator (DLA) on NVIDIA Jetson
  ☆316Updated 2 years ago
• maggiez0138 / yolov5_quant_sample
  This is 8-bit quantization sample for yolov5. Both PTQ, QAT and Partial Quantization have been implemented, and present the results based…
  ☆98Updated 2 years ago
• mit-han-lab / inter-operator-scheduler
  [MLSys 2021] IOS: Inter-Operator Scheduler for CNN Acceleration
  ☆197Updated 2 years ago
• NVIDIA-AI-IOT / cuDLA-samples
  YOLOv5 on Orin DLA
  ☆189Updated last year
• leimao / TensorRT-Custom-Plugin-Example
  Quick and Self-Contained TensorRT Custom Plugin Implementation and Integration
  ☆51Updated 8 months ago
• NVIDIA / Deep-Learning-Accelerator-SW
  NVIDIA DLA-SW, the recipes and tools for running deep learning workloads on NVIDIA DLA cores for inference applications.
  ☆189Updated 8 months ago
• leimao / PyTorch-Static-Quantization
  PyTorch Static Quantization Example
  ☆38Updated 3 years ago
• gmalivenko / onnx-opcounter
  Count number of parameters / MACs / FLOPS for ONNX models.
  ☆90Updated 3 months ago
• irvingzhang0512 / tvm_tests
  ☆17Updated 4 years ago
• OpenPPL / ppl.common
  Common libraries for PPL projects
  ☆29Updated 4 months ago
• NVIDIA-AI-IOT / yolov5_gpu_optimization
  This repository provides YOLOV5 GPU optimization sample
  ☆102Updated 2 years ago
• masahi / torchscript-to-tvm
  ☆69Updated last year
• ModelTC / Dipoorlet
  Offline Quantization Tools for Deploy.
  ☆123Updated last year
• NVlabs / HALP
  ☆66Updated 2 years ago
• ArtyZe / yolo_quantization
  Based of paper "Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference"
  ☆62Updated 4 years ago
• ankan-ban / llama_cu_awq
  llama INT4 cuda inference with AWQ
  ☆50Updated last month
• sefaburakokcu / quantized-yolov5
  Low Precision(quantized) Yolov5
  ☆33Updated last year
• kentaroy47 / benchmark-FP32-FP16-INT8-with-TensorRT
  Benchmark inference speed of CNNs with various quantization methods in Pytorch+TensorRT with Jetson Nano/Xavier
  ☆55Updated last year
• Kyrie-Zhao / awesome-real-time-AI
  This is a list of awesome edgeAI inference related papers.
  ☆92Updated last year
• microsoft / microxcaling
  PyTorch emulation library for Microscaling (MX)-compatible data formats
  ☆199Updated 4 months ago
• Qualcomm-AI-research / FP8-quantization
  ☆136Updated last year
• casys-kaist / Edge-scheduler
  ☆13Updated 3 years ago
• leimao / PyTorch-Quantization-Aware-Training
  PyTorch Quantization Aware Training Example
  ☆128Updated 9 months ago
• Bruce-Lee-LY / cuda_hgemv
  Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.
  ☆55Updated 5 months ago
• levipereira / yolov9-qat
  Implementation of YOLOv9 QAT optimized for deployment on TensorRT platforms.
  ☆100Updated 3 months ago
• xxxxyu / FlexNN
  Code for ACM MobiCom 2024 paper "FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices"
  ☆49Updated 3 weeks ago
• OpenPPL / ppl.kernel.cuda
  ☆35Updated 4 months ago
• ModelTC / NNLQP
  ☆34Updated 2 years ago
• tlc-pack / cutlass_fpA_intB_gemm
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆88Updated 11 months ago