Whisper in TensorRT-LLM
☆16Sep 21, 2023Updated 3 years ago
Alternatives and similar repositories for whisper-trtllm
Users that are interested in whisper-trtllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆43Oct 20, 2023Updated 3 years ago
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆50Aug 16, 2023Updated 3 years ago
- mnn asr demo.☆27Mar 24, 2025Updated last year
- A list of papers for Graph Retrieval-Augmented Generation (GraphRAG).☆10Mar 13, 2025Updated last year
- ☆11Jan 9, 2019Updated 7 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Fast Neural Network Super-resolution tool based on TensorRT☆15Jun 6, 2026Updated 5 months ago
- 很好用的tnn classify demo☆11Mar 24, 2021Updated 5 years ago
- Ongoing research training transformer models at scale☆13Updated this week
- opencv调用jetson/rk3588 mpp硬解码，重写了open与read函数，支 持h264/h265☆14Aug 4, 2026Updated 3 months ago
- Transformer related optimization, including BERT, GPT☆17Jul 29, 2023Updated 3 years ago
- A data processing framework☆11Jul 19, 2017Updated 9 years ago
- A PyTorch implementation of the ACM SIGKDD 2021 paper titled "PETGEN: Personalized Text Generation Attack on Deep Sequence Embedding-base…☆17Dec 19, 2023Updated 2 years ago
- Bridging python and matlab version OTB☆11Jan 12, 2018Updated 8 years ago
- ☆26Aug 15, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Sources to www.mlpack.org.☆13Jun 19, 2026Updated 4 months ago
- c++实现的clip推理，模型有一点点改动，但是不大，改动和导出模型的代码可以在readme里找到，模型文件都在Releases里，包括AX650的模型。新增支持ChineseCLIP☆31Jun 19, 2025Updated last year
- 大一的软件课程设计I的Qt项目，一部分参考了黑马程序员的教程（十分感谢）。实现了具备背景、bgm的可视化界面六子棋，可以也改成五子棋，实现了人人对战、人机对战、机机对战（观看）功能，可以更改是否开启禁手。☆10Apr 21, 2022Updated 4 years ago
- ☆27Sep 1, 2023Updated 3 years ago
- Ultra fast head pose estimation on a bare Raspberry Pi 4 at 20 FPS☆10Dec 21, 2021Updated 4 years ago
- FA4-based Relative Attention Kernel developed by TML and Colfax☆18Sep 11, 2026Updated last month
- 使用NCNN推理框架和ByteTrack目标跟踪框架，对网络、文件流URL进行实时性视频推理，而UI界面则由Qt框架实现☆24Oct 16, 2024Updated 2 years ago
- Deploying a deep learning model to Android☆11Sep 28, 2024Updated 2 years ago
- ☆20Sep 28, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆126Dec 15, 2023Updated 2 years ago
- ☆13Jan 7, 2025Updated last year
- ppstructure deploy by ncnn☆36Jul 16, 2024Updated 2 years ago
- ☆34Feb 3, 2025Updated last year
- 一个基于 LlamaIndex 和 Streamlit 构建的 PDF 智能问答系统☆12Feb 12, 2025Updated last year
- ☆90Jun 30, 2023Updated 3 years ago
- IPASS -- Image Processing Algorithm Simulation Software☆12Jul 25, 2025Updated last year
- UIE(Universal Information Extraction) infer by ncnn☆15Sep 22, 2024Updated 2 years ago
- Standalone Flash Attention v2 kernel without libtorch dependency☆113Sep 10, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Handwritten GEMM using Intel AMX (Advanced Matrix Extension)☆17Jan 11, 2025Updated last year
- Rust implementation of RaBitQ + IVF and MSTG (multi-scale tree graph)☆19Feb 26, 2026Updated 8 months ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆96Jun 21, 2026Updated 4 months ago
- An easy way to run, test, benchmark and tune OpenCL kernel files☆24Aug 25, 2023Updated 3 years ago
- YOLOV8Pose's NCNN Android Optimization Deployment☆12Dec 2, 2024Updated last year
- ☆23Aug 14, 2024Updated 2 years ago
- 用于YOLO11模型转化为RKNN模型在RK系列开发板上面部署☆15Sep 21, 2025Updated last year