Deep-Spark / DeepSparkInferenceLinks
DeepSparkInference has selected 216 inference models of both small and large sizes. The small models cover fields such as computer vision, natural language processing, and speech recognition; the LLMs involve various frameworks including vLLM, TGI and LMDeploy. This repository is the mirror of Gitee.
☆25Updated last week
Alternatives and similar repositories for DeepSparkInference
Users that are interested in DeepSparkInference are comparing it to the libraries listed below
Sorting:
- simplify >2GB large onnx model☆63Updated 11 months ago
- NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆43Updated 2 years ago
- The DeepSpark open platform selects hundreds of open source application algorithms and models that are deeply coupled with industrial app…☆45Updated last month
- Large Language Model Onnx Inference Framework☆36Updated this week
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆50Updated 2 years ago
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆50Updated 2 years ago
- Serving Inside Pytorch☆163Updated last month
- llm deploy project based onnx.☆45Updated last year
- Compare multiple optimization methods on triton to imporve model service performance☆52Updated last year
- A Toolkit to Help Optimize Large Onnx Model☆161Updated last week
- ☆72Updated 2 years ago
- Transformer related optimization, including BERT, GPT☆17Updated 2 years ago
- ☆59Updated 11 months ago
- Whisper in TensorRT-LLM☆16Updated 2 years ago
- ☆26Updated 2 years ago
- DeepSparkHub selects hundreds of application algorithms and models, covering various fields of AI and general-purpose computing, to suppo…☆69Updated last week
- qwen2 and llama3 cpp implementation☆47Updated last year
- Triton Inferece Server Model Config and Client Scripts☆32Updated 3 years ago
- ☆124Updated last year
- autoTVM神经网络推理代码优化搜索演示，基于tvm编译开源模型centerface，并使用autoTVM搜索最优推理代码， 最终部署编译为c++代码，演示平台是cuda，可以是其他平台，例如树莓派，安卓手机，苹果手机．Thi is a demonstration of …☆28Updated 4 years ago
- llm-export can export llm model to onnx.☆317Updated last week
- ☆100Updated 4 years ago
- stable diffusion using mnn☆67Updated 2 years ago
- run ChatGLM2-6B in BM1684X☆50Updated last year
- TensorRT 2022复赛方案： 首个基于Transformer的图像重建模型MST++的TensorRT模型推断优化☆143Updated 3 years ago
- Wanwu models release, code will be released soon☆24Updated 3 years ago
- EasyNN是一个面向教学而开发的神经网络推理框架，旨在让大家0基础也能自主完成推理框架编写！☆33Updated last year
- ☆37Updated last year
- c++实现的clip推理，模型有一点点改动，但是不大，改动和导出模型的代码可以在readme里找到，模型文件都在Releases里，包括AX650的模型。新增支持ChineseCLIP☆30Updated 4 months ago
- 大模型部署实战：TensorRT-LLM, Triton Inference Server, vLLM☆26Updated last year