Alternatives and similar repositories for DeepSparkInference:

Users that are interested in DeepSparkInference are comparing it to the libraries listed below

• Deep-Spark / DeepSpark
  The DeepSpark open platform selects hundreds of open source application algorithms and models that are deeply coupled with industrial app…
  ☆42Updated 2 weeks ago
• Deep-Spark / DeepSparkHub
  DeepSparkHub selects hundreds of application algorithms and models, covering various fields of AI and general-purpose computing, to suppo…
  ☆63Updated this week
• Deep-Spark / iluvatar-corex-ixrt
  This repository contains the Open Source Software components of the Iluvatar Corex IxRT. It includes the sources for IxRT plugins and dep…
  ☆16Updated last month
• luchangli03 / onnxsim_large_model
  simplify >2GB large onnx model
  ☆55Updated 4 months ago
• dingyuqing05 / trt2022_wenet
  ☆71Updated 2 years ago
• OpenPPL / ppl.pmx
  ☆58Updated 5 months ago
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆46Updated last year
• xiatwhu / trt2023
  ☆26Updated last year
• Tlntin / trt2023
  ☆24Updated last year
• BBuf / onnx_learn
  ☆99Updated 3 years ago
• TRT2022 / ControlNet_TensorRT
  天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案
  ☆49Updated last year
• inisis / OnnxLLM
  Large Language Model Onnx Inference Framework
  ☆32Updated 3 months ago
• OpenPPL / ppl.kernel.cuda
  ☆36Updated 6 months ago
• leoluopy / autotvm_tutorial
  autoTVM神经网络推理代码优化搜索演示，基于tvm编译开源模型centerface，并使用autoTVM搜索最优推理代码，　最终部署编译为c++代码，演示平台是cuda，可以是其他平台，例如树莓派，安卓手机，苹果手机．Thi is a demonstration of …
  ☆27Updated 3 years ago
• bug-developer021 / YOLOV5_optimization_on_triton
  Compare multiple optimization methods on triton to imporve model service performance
  ☆50Updated last year
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated last year
• OpenPPL / ppl.nn.llm
  ☆139Updated last year
• OpenPPL / ppl.llm.serving
  ☆127Updated 4 months ago
• bytedance / ByteMLPerf
  AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…
  ☆238Updated last week
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆42Updated last year
• bindog / onnx-surgery
  ☆80Updated 4 years ago
• MegEngine / mgeconvert
  MegEngine到其他框架的转换器
  ☆69Updated 2 years ago
• AI-performance / embedded-ai.bench
  benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.
  ☆204Updated 4 years ago
• torchpipe / torchpipe
  Serving Inside Pytorch
  ☆160Updated this week
• BBuf / how-to-optimize-gemm
  ☆96Updated 3 years ago
• bxttttt / getting-started-guide-and-introduction-to-MXMACA
  MXMACA入门materials
  ☆18Updated 10 months ago
• inisis / caffe2onnx
  caffe model to onnx
  ☆33Updated 2 years ago
• TRT2022 / MST-plus-plus-TensorRT
  TensorRT 2022复赛方案： 首个基于Transformer的图像重建模型MST++的TensorRT模型推断优化
  ☆138Updated 2 years ago
• zzk0 / triton
  Triton Inferece Server Model Config and Client Scripts
  ☆32Updated 3 years ago
• Zhengtq / ncnn_breakdown
  A breakdown of NCNN
  ☆46Updated 4 years ago