Deep-Spark / DeepSparkInferenceLinks
DeepSparkInference has selected 216 inference models of both small and large sizes. The small models cover fields such as computer vision, natural language processing, and speech recognition; the LLMs involve various frameworks including vLLM, TGI and LMDeploy. This repository is the mirror of Gitee.
☆24Updated this week
Alternatives and similar repositories for DeepSparkInference
Users that are interested in DeepSparkInference are comparing it to the libraries listed below
Sorting:
- simplify >2GB large onnx model☆63Updated 9 months ago
- The DeepSpark open platform selects hundreds of open source application algorithms and models that are deeply coupled with industrial app…☆44Updated last week
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆50Updated last year
- A Toolkit to Help Optimize Large Onnx Model☆158Updated last year
- ☆72Updated 2 years ago
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化