Deep-Spark / DeepSparkInference
DeepSparkInference has selected 48 inference model examples, covering fields such as computer vision, natural language processing, and speech recognition. Subsequent phases will gradually expand to more AI fields.
☆17Updated last week
Alternatives and similar repositories for DeepSparkInference:
Users that are interested in DeepSparkInference are comparing it to the libraries listed below
- The DeepSpark open platform selects hundreds of open source application algorithms and models that are deeply coupled with industrial app…☆41Updated last week
- DeepSparkHub selects hundreds of application algorithms and models, covering various fields of AI and general-purpose computing, to suppo…☆63Updated last week
- This repository contains the Open Source Software components of the Iluvatar Corex IxRT. It includes the sources for IxRT plugins and dep…☆14Updated last week
- simplify >2GB large onnx model☆54Updated 4 months ago
- ☆71Updated 2 years ago
- ☆58Updated 4 months ago
- Large Language Model Onnx Inference Framework☆32Updated 2 months ago
- caffe model to onnx☆33Updated 2 years ago
- autoTVM神经网络推理代码优化搜索演示,基于tvm编译开源模型centerface,并使用autoTVM搜索最优推理代码, 最终部署编译为c++代码,演示平台是cuda,可以是其他平台,例如树莓派,安卓手机,苹果手机.Thi is a demonstration of …☆27Updated 3 years ago
- llm deploy project based onnx.☆35Updated 5 months ago
- ☆95Updated 3 years ago
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆41Updated last year
- ☆36Updated 5 months ago
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆46Updated last year
- ☆11Updated last year
- Tengine Convert Tool supports converting multi framworks' models into tmfile that suitable for Tengine-Lite AI framework.☆93Updated 3 years ago
- MegEngine到其他框架的转换器☆69Updated last year
- run ChatGLM2-6B in BM1684X☆49Updated last year
- ☆124Updated last year
- EasyNN是一个面向教学而开发的神经网络推理框架,旨在让大家0基础也能自主完成推理框架编写!☆26Updated 7 months ago
- Triton Inferece Server Model Config and Client Scripts☆32Updated 3 years ago
- ☆79Updated 4 years ago
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆49Updated last year
- Serving Inside Pytorch☆160Updated this week
- A light llama-like llm inference framework based on the triton kernel.☆103Updated 3 weeks ago
- ONNX Runtime: cross-platform, high performance scoring engine for ML models☆60Updated this week
- ☆145Updated 2 months ago
- ☆12Updated last year
- ☆139Updated 11 months ago
- ☆24Updated last year