Whisper in TensorRT-LLM
☆16Sep 21, 2023Updated 3 years ago
Alternatives and similar repositories for whisper-trtllm
Users that are interested in whisper-trtllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆43Oct 20, 2023Updated 2 years ago
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆50Aug 16, 2023Updated 3 years ago
- Implementation of our paper published in Springer's Signal, Image and Video Processing☆12Dec 5, 2020Updated 5 years ago
- mnn asr demo.☆27Mar 24, 2025Updated last year
- 很好用的tnn classify demo☆11Mar 24, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Transformer related optimization, including BERT, GPT☆17Jul 29, 2023Updated 3 years ago
- ☆26Aug 15, 2023Updated 3 years ago
- ☆13Jan 7, 2025Updated last year
- Ultra fast head pose estimation on a bare Raspberry Pi 4 at 20 FPS☆10Dec 21, 2021Updated 4 years ago
- 使用NCNN推理框架和ByteTrack目标跟踪框架，对网络、文件流URL进行实时性视频推理，而UI界面则由Qt框架实现☆24Oct 16, 2024Updated last year
- Deploy ChatGLM on Modelz☆16Mar 20, 2023Updated 3 years ago
- ☆27Sep 1, 2023Updated 3 years ago
- ppstructure deploy by ncnn☆36Jul 16, 2024Updated 2 years ago
- ☆34Feb 3, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆20Sep 28, 2024Updated last year
- ☆126Dec 15, 2023Updated 2 years ago
- FA4-based Relative Attention Kernel developed by TML and Colfax☆18Sep 11, 2026Updated 2 weeks ago
- IPASS -- Image Processing Algorithm Simulation Software☆12Jul 25, 2025Updated last year
- ☆90Jun 30, 2023Updated 3 years ago
- An easy way to run, test, benchmark and tune OpenCL kernel files☆24Aug 25, 2023Updated 3 years ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆96Jun 21, 2026Updated 3 months ago
- PyTorch implementation of Image Super-Resolution via Deep Recursive Residual Network (CVPR 2017)☆23Jun 5, 2019Updated 7 years ago
- vLLM Router☆59Mar 11, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 使用OpenCV部署CoupledTPS，包含了肖像矫正，不规则边界的图像矩形化，旋转图像矫正，三个模型。依然是包含C++和Python两个版本的程序☆22Jul 4, 2024Updated 2 years ago
- 用于YOLO11模型转化为RKNN模型在RK系列开发板上面部署☆16Sep 21, 2025Updated last year
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆99Jul 27, 2026Updated 2 months ago
- CUDA SGEMM optimization note☆16Oct 31, 2023Updated 2 years ago
- Decoders from Kaldi using OpenFst☆35Apr 10, 2026Updated 5 months ago
- 基于Qwen2模型进行通用信息抽取【实体/关系/事件抽取】☆40Jul 10, 2024Updated 2 years ago
- 该项目实现了图像超分辨率算法ELAN的TensorRT版本。☆31Jul 9, 2022Updated 4 years ago
- SCRFD face detection based on MNN inference framework☆18Sep 22, 2021Updated 5 years ago
- [MIR] Pytorch Implementation for FM2S, a denoising algorithm for fluorescence microscopy.☆15Mar 13, 2026Updated 6 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 基于seq2edit (Gector) 的中文文本纠错。☆29Nov 15, 2022Updated 3 years ago
- An implementation of <Group Fisher Pruning for Practical Network Compression> based on pytorch and mmcv☆18Nov 21, 2021Updated 4 years ago
- NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that del…☆26Jul 21, 2023Updated 3 years ago
- ☆21Mar 22, 2021Updated 5 years ago
- An inverse halftoning model, which is applied to recover the 8-bit grayscale image from 1-bit error diffused halftones. [ACCV 2018]☆28Aug 10, 2022Updated 4 years ago
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆54Oct 20, 2023Updated 2 years ago
- convert paddleOCR to torchOCR, ppocr-v3,ppocr-v4, onnx, openvino☆33Aug 16, 2023Updated 3 years ago