EdVince / whisper-trtllmLinks
Whisper in TensorRT-LLM
☆17Updated 2 years ago
Alternatives and similar repositories for whisper-trtllm
Users that are interested in whisper-trtllm are comparing it to the libraries listed below
Sorting:
- libvits-ncnn is an ncnn implementation of the VITS library that enables cross-platform GPU-accelerated speech synthesis.🎙️💻☆62Updated 2 years ago
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆43Updated 2 years ago
- 使用onnxruntime部署实时视频帧插值,包含C++和Python两个版本的程序☆27Updated last year
- qwen2 and llama3 cpp implementation☆49Updated last year
- Inference TinyLlama models on ncnn☆24Updated 2 years ago
- ☆125Updated 2 years ago
- mnn asr demo.☆23Updated 9 months ago
- ☆33Updated last year
- 很好用的tnn classify demo☆11Updated 4 years ago
- UIE(Universal Information Extraction) infer by ncnn☆15Updated last year
- 使用OpenCV部署CoupledTPS,包含了肖像矫正,不规则边界的图像矩形化,旋转图像矫正,三个模型。依然是包含C++和Python两个版本的程序☆20Updated last year
- c++实现的clip推理,模型有一点点改动,但是不大,改动和导出模型的代码可以在readme里找到,模型文件都在Releases里,包括AX650的模型。新增支持ChineseCLIP☆30Updated 6 months ago
- ☆27Updated 5 months ago
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆50Updated 2 years ago
- llm deploy project based onnx.☆47Updated last year
- ncnn HiFi-GAN☆29Updated last year
- some ncnn demos of FunASR☆28Updated last year
- Wanwu models release, code will be released soon☆24Updated 3 years ago
- ☆75Updated 3 years ago
- Windows 💻 RobustVideoMatting with ONNXRuntime/MNN/TNN C++/Python☆12Updated 3 years ago
- 用于学习GOT/Qwen/OnnxLLm☆53Updated last year
- Large Language Model Onnx Inference Framework☆36Updated last month
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆51Updated 2 years ago
- a naive example of LivePortrait infer by ncnn☆43Updated last year
- ☆42Updated 3 years ago
- A Toolkit to Help Optimize Large Onnx Model☆162Updated 2 months ago
- 使用ONNXRuntime部署E2Pose人体关键点检测,一共包含20个onnx模型,依然是C++和Python两个版本的程序☆16Updated 3 years ago
- HunyuanDiT with TensorRT and libtorch☆18Updated last year
- DeepSparkInference has selected 216 inference models of both small and large sizes. The small models cover fields such as computer vision…☆26Updated last week
- SCRFD face detection based on MNN inference framework☆17Updated 4 years ago