Deep-Spark / DeepSparkInferenceLinks
DeepSparkInference has selected 216 inference models of both small and large sizes. The small models cover fields such as computer vision, natural language processing, and speech recognition; the LLMs involve various frameworks including vLLM, TGI and LMDeploy. This repository is the mirror of Gitee.
☆24Updated last week
Alternatives and similar repositories for DeepSparkInference
Users that are interested in DeepSparkInference are comparing it to the libraries listed below
Sorting:
- simplify >2GB large onnx model☆63Updated 9 months ago
- The DeepSpark open platform selects hundreds of open source application algorithms and models that are deeply coupled with industrial app…☆44Updated last week
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆42Updated last year
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆50Updated last year
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆50Updated 2 years ago
- Compare multiple optimization methods on triton to imporve model service performance☆53Updated last year
- Serving Inside Pytorch☆163Updated last month
- A Toolkit to Help Optimize Large Onnx Model☆159Updated last year
- ☆72Updated 2 years ago
- DeepSparkHub selects hundreds of application algorithms and models, covering various fields of AI and general-purpose computing, to suppo…☆67Updated last week
- ☆26Updated 2 years ago
- Transformer related optimization, including BERT, GPT☆17Updated 2 years ago
- Large Language Model Onnx Inference Framework☆36Updated 8 months ago
- ☆99Updated 4 years ago
- ☆125Updated last year
- llm deploy project based onnx.☆44Updated 11 months ago
- Wanwu models release, code will be released soon☆24Updated 3 years ago
- run ChatGLM2-6B in BM1684X☆49Updated last year
- ☆90Updated 2 years ago
- autoTVM神经网络推理代码优化搜索演示,基于tvm编译开源模型centerface,并使用autoTVM搜索最优推理代码, 最终部署编译为c++代码,演示平台是cuda,可以是其他平台,例如树莓派,安卓手机,苹果手机.Thi is a demonstration of …☆28Updated 4 years ago
- qwen2 and llama3 cpp implementation☆47Updated last year
- A breakdown of NCNN☆46Updated 4 years ago
- Using TensorRT for Inference Model Deployment.☆49Updated last year
- ☆120Updated 2 years ago
- Triton Inferece Server Model Config and Client Scripts☆32Updated 3 years ago
- async inference for machine learning model☆26Updated 2 years ago
- ☆59Updated 9 months ago
- TensorRT 2022复赛方案: 首个基于Transformer的图像重建模型MST++的TensorRT模型推断优化☆142Updated 3 years ago
- export llama to onnx☆134Updated 8 months ago
- Whisper in TensorRT-LLM☆16Updated last year