NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
☆43Oct 20, 2023Updated 3 years ago
Alternatives and similar repositories for trt2023
Users that are interested in trt2023 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Whisper in TensorRT-LLM☆16Sep 21, 2023Updated 3 years ago
- a repo to study TensorRT Plugin☆11Apr 30, 2025Updated last year
- HunyuanDiT with TensorRT and libtorch☆18May 22, 2024Updated 2 years ago
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆50Aug 16, 2023Updated 3 years ago
- learn TensorRT from scratch🥰☆18Sep 29, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 搜藏的希望的代码片段☆13Jun 6, 2023Updated 3 years ago
- ☆26Aug 15, 2023Updated 3 years ago
- YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现☆14Mar 5, 2025Updated last year
- SAM and lama inpaint，包含QT的GUI交互界面，实现了交互式可实时显示结果的画点、画框进行SAM，然后通过进行Inpaint，具体操作看readme里的视频。☆54Jan 30, 2024Updated 2 years ago
- 使用cuda实现类似sahi库的切图☆13Jul 21, 2026Updated 3 months ago
- an example of segment-anything infer by ncnn☆123May 5, 2023Updated 3 years ago
- This is a repository to practice multi-thread programming in C++☆33Feb 21, 2024Updated 2 years ago
- 基于 CUDA Driver API 的 cuda 运行时环境☆16Jul 30, 2025Updated last year
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Standalone Flash Attention v2 kernel without libtorch dependency☆113Sep 10, 2024Updated 2 years ago
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆54Oct 20, 2023Updated 3 years ago
- ☆23Aug 20, 2025Updated last year
- Qwen-Image's DiT inference with TensorRT-10☆21Oct 13, 2025Updated last year
- c++实现的clip推理，模型有一点点改动，但是不大，改动和导出模型的代码可以在readme里找到，模型文件都在Releases里，包括AX650的模型。新增支持ChineseCLIP☆31Jun 19, 2025Updated last year
- PointPillars 部署tensorrt☆10Nov 12, 2024Updated last year
- ☆10May 14, 2024Updated 2 years ago
- ☆19Jan 31, 2022Updated 4 years ago
- ☆15Dec 1, 2023Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- TensorRT 2022复赛方案： 首个基于Transformer的图像重建模型MST++的TensorRT模型推断优化☆143Jul 6, 2022Updated 4 years ago
- This repository provides tutorial, which discusses running sample publisher and subscriber using multiple transports of point_cloud_trans…☆11Aug 26, 2026Updated 2 months ago
- deepstream + cuda，yolo26，yolo-master，yolo11，yolov8，sam，transformer, etc.☆27Feb 7, 2026Updated 8 months ago
- ☆27Sep 1, 2023Updated 3 years ago
- a naive example of LivePortrait infer by ncnn☆47Aug 7, 2024Updated 2 years ago
- Implementation of our paper published in Springer's Signal, Image and Video Processing☆12Dec 5, 2020Updated 5 years ago
- ncnn version of CodeFormer☆109Mar 9, 2023Updated 3 years ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆96Jun 21, 2026Updated 4 months ago
- FastSAM 部署rknn C++ 代码☆14May 30, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。☆12Jan 9, 2024Updated 2 years ago
- ☆79Nov 26, 2024Updated last year
- ONNX-compatible DocShadow: High-Resolution Document Shadow Removal. Supports TensorRT 🚀☆27Sep 13, 2023Updated 3 years ago
- 使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention☆82Aug 12, 2024Updated 2 years ago
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 3 months ago
- unofficial implementation of YOLOP TensorRT☆12Dec 11, 2021Updated 4 years ago
- ☆21Mar 22, 2021Updated 5 years ago