Alternatives and similar repositories for DeepSparkInference:

Users that are interested in DeepSparkInference are comparing it to the libraries listed below

• Deep-Spark / DeepSpark
  The DeepSpark open platform selects hundreds of open source application algorithms and models that are deeply coupled with industrial app…
  ☆42Updated last month
• Deep-Spark / DeepSparkHub
  DeepSparkHub selects hundreds of application algorithms and models, covering various fields of AI and general-purpose computing, to suppo…
  ☆59Updated this week
• dingyuqing05 / trt2022_wenet
  ☆72Updated 2 years ago
• luchangli03 / onnxsim_large_model
  simplify >2GB large onnx model
  ☆52Updated 2 months ago
• Deep-Spark / iluvatar-corex-ixrt
  This repository contains the Open Source Software components of the Iluvatar Corex IxRT. It includes the sources for IxRT plugins and dep…
  ☆14Updated 5 months ago
• OpenPPL / ppl.pmx
  ☆57Updated 3 months ago
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆44Updated last year
• Adlik / model_zoo
  ☆11Updated last year
• OpenPPL / ppl.kernel.cuda
  ☆35Updated 4 months ago
• TRT2022 / MST-plus-plus-TensorRT
  TensorRT 2022复赛方案： 首个基于Transformer的图像重建模型MST++的TensorRT模型推断优化
  ☆138Updated 2 years ago
• leoluopy / autotvm_tutorial
  autoTVM神经网络推理代码优化搜索演示，基于tvm编译开源模型centerface，并使用autoTVM搜索最优推理代码，　最终部署编译为c++代码，演示平台是cuda，可以是其他平台，例如树莓派，安卓手机，苹果手机．Thi is a demonstration of …
  ☆27Updated 3 years ago
• OpenPPL / ppl.nn.llm
  ☆140Updated 9 months ago
• BBuf / how-to-optimize-gemm
  ☆95Updated 3 years ago
• Tlntin / trt2023
  ☆23Updated last year
• MegEngine / mgeconvert
  MegEngine到其他框架的转换器
  ☆69Updated last year
• Adlik / smoothquantplus
  [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
  ☆20Updated 11 months ago
• OpenPPL / ppl.llm.kernel.cuda
  ☆142Updated last month
• wangzyon / trt_learn
  TensorRT encapsulation, learn, rewrite, practice.
  ☆28Updated 2 years ago
• OpenPPL / ppl.llm.serving
  ☆127Updated last month
• whitelok / tvm-lesson
  动手学习TVM核心原理教程
  ☆59Updated 4 years ago
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆41Updated last year
• alibaba / heterogeneity-aware-lowering-and-optimization
  heterogeneity-aware-lowering-and-optimization
  ☆254Updated last year
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated last year
• daquexian / faster-rwkv
  ☆124Updated last year
• tsingmicro-toolchain / OnnxSlim
  A Toolkit to Help Optimize Large Onnx Model
  ☆153Updated 9 months ago
• Zhengtq / ncnn_breakdown
  A breakdown of NCNN
  ☆46Updated 4 years ago
• tpoisonooo / chgemm
  symmetric int8 gemm
  ☆66Updated 4 years ago
• masahi / torchscript-to-tvm
  ☆69Updated last year
• Laicheng0830 / Pytorch_Model_Quantization
  OpenPose uses Pytorch for static quantization, saving, and loading of models
  ☆82Updated 3 years ago
• torchpipe / torchpipe
  Serving Inside Pytorch
  ☆154Updated this week