Alternatives and similar repositories for DeepSparkInference:

Users that are interested in DeepSparkInference are comparing it to the libraries listed below

• Deep-Spark / DeepSpark
  The DeepSpark open platform selects hundreds of open source application algorithms and models that are deeply coupled with industrial app…
  ☆41Updated last week
• Deep-Spark / DeepSparkHub
  DeepSparkHub selects hundreds of application algorithms and models, covering various fields of AI and general-purpose computing, to suppo…
  ☆63Updated last week
• Deep-Spark / iluvatar-corex-ixrt
  This repository contains the Open Source Software components of the Iluvatar Corex IxRT. It includes the sources for IxRT plugins and dep…
  ☆14Updated last week
• luchangli03 / onnxsim_large_model
  simplify >2GB large onnx model
  ☆54Updated 4 months ago
• dingyuqing05 / trt2022_wenet
  ☆71Updated 2 years ago
• OpenPPL / ppl.pmx
  ☆58Updated 4 months ago
• inisis / OnnxLLM
  Large Language Model Onnx Inference Framework
  ☆32Updated 2 months ago
• inisis / caffe2onnx
  caffe model to onnx
  ☆33Updated 2 years ago
• leoluopy / autotvm_tutorial
  autoTVM神经网络推理代码优化搜索演示，基于tvm编译开源模型centerface，并使用autoTVM搜索最优推理代码，　最终部署编译为c++代码，演示平台是cuda，可以是其他平台，例如树莓派，安卓手机，苹果手机．Thi is a demonstration of …
  ☆27Updated 3 years ago
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆35Updated 5 months ago
• BBuf / how-to-optimize-gemm
  ☆95Updated 3 years ago
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆41Updated last year
• OpenPPL / ppl.kernel.cuda
  ☆36Updated 5 months ago
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆46Updated last year
• Adlik / model_zoo
  ☆11Updated last year
• OAID / Tengine-Convert-Tools
  Tengine Convert Tool supports converting multi framworks' models into tmfile that suitable for Tengine-Lite AI framework.
  ☆93Updated 3 years ago
• MegEngine / mgeconvert
  MegEngine到其他框架的转换器
  ☆69Updated last year
• sophgo / ChatGLM2-TPU
  run ChatGLM2-6B in BM1684X
  ☆49Updated last year
• daquexian / faster-rwkv
  ☆124Updated last year
• HuPengsheet / EasyNN
  EasyNN是一个面向教学而开发的神经网络推理框架，旨在让大家0基础也能自主完成推理框架编写！
  ☆26Updated 7 months ago
• zzk0 / triton
  Triton Inferece Server Model Config and Client Scripts
  ☆32Updated 3 years ago
• bindog / onnx-surgery
  ☆79Updated 4 years ago
• TRT2022 / ControlNet_TensorRT
  天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案
  ☆49Updated last year
• torchpipe / torchpipe
  Serving Inside Pytorch
  ☆160Updated this week
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆103Updated 3 weeks ago
• intel / onnxruntime
  ONNX Runtime: cross-platform, high performance scoring engine for ML models
  ☆60Updated this week
• OpenPPL / ppl.llm.kernel.cuda
  ☆145Updated 2 months ago
• inisis / caffe
  ☆12Updated last year
• OpenPPL / ppl.nn.llm
  ☆139Updated 11 months ago
• Tlntin / trt2023
  ☆24Updated last year