FeiGeChuanShu / trt2023
NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
☆40Updated last year
Related projects ⓘ
Alternatives and complementary repositories for trt2023
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆47Updated last year
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆44Updated last year
- HunyuanDiT with TensorRT and libtorch☆15Updated 5 months ago
- ☆23Updated last year
- 大模型部署实战：TensorRT-LLM, Triton Inference Server, vLLM☆26Updated 8 months ago
- simplify >2GB large onnx model☆44Updated 8 months ago
- Whisper in TensorRT-LLM☆14Updated last year
- A tool convert TensorRT engine/plan to a fake onnx☆37Updated last year
- SAM and lama inpaint，包含QT的GUI交互界面，实现了交互式可实时显示结果的画点、画框进行SAM，然后通过进行Inpaint，具体操作看readme里的视频。☆40Updated 9 months ago
- run ChatGLM2-6B in BM1684X☆48Updated 8 months ago
- ☆19Updated 10 months ago
- llm deploy project based onnx.☆26Updated last month
- Large Language Model Onnx Inference Framework☆25Updated last month
- ☆19Updated last month
- Decoding Attention is specially optimized for multi head attention (MHA) using CUDA core for the decoding stage of LLM inference.☆23Updated 2 weeks ago
- ffmpeg+cuvid+tensorrt+multicamera☆12Updated last year
- A Toolkit to Help Optimize Onnx Model☆80Updated this week
- ☆17Updated 10 months ago
- https://start.oneflow.org/oneflow-yolo-doc☆22Updated last year
- Compare multiple optimization methods on triton to imporve model service performance☆46Updated 10 months ago
- Wanwu models release, code will be released soon☆24Updated 2 years ago
- c++实现的clip推理，模型有一点点改动，但是不大，改动和导出模型的代码可以在readme里找到，模型文件都在Releases里，包括AX650的模型。新增支持ChineseCLIP☆27Updated 10 months ago
- ggml学习笔记，ggml是一个机器学习的推理框架☆11Updated 7 months ago
- async inference for machine learning model☆26Updated 2 years ago
- ☆24Updated last year
- qwen2 and llama3 cpp implementation☆34Updated 5 months ago
- 基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat☆48Updated 7 months ago
- OneFlow->ONNX☆42Updated last year
- stable diffusion using mnn☆63Updated last year