本仓库在OpenVINO推理框架下部署Nanodet检测算法，并重写预处理和后处理部分，具有超高性能！让你在Intel CPU平台上的检测速度起飞！ 并基于NNCF和PPQ工具将模型量化(PTQ)至int8精度，推理速度更快！
☆16Jun 14, 2023Updated 2 years ago
Alternatives and similar repositories for Nanodet_openvino_quant_deploy
Users that are interested in Nanodet_openvino_quant_deploy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 本仓库基于 Intel OpenVINO Toolkit 部署 LightTrack 跟踪算法，包含 Python、C++ 两种语言的推理代码.☆21Nov 2, 2023Updated 2 years ago
- HunyuanDiT with TensorRT and libtorch☆18May 22, 2024Updated last year
- YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现☆13Mar 5, 2025Updated last year
- ☆30Nov 16, 2024Updated last year
- ☆22Apr 10, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Minimal PyTorch implementation of SOLOv2.☆15Jan 14, 2025Updated last year
- Multi-agent version of Voxblox. Used in the paper "Multi-robot Coordination with Agent-Server Architecture for Autonomous Navigation in P…☆20Sep 21, 2020Updated 5 years ago
- Llama3 Streaming Chat Sample☆22Apr 24, 2024Updated last year
- 对 tensorRT_Pro 开源项目理解☆22Feb 23, 2023Updated 3 years ago
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- 基于TensorRT的C++高性能推理库，Yolov10, YoloPv2，Yolov5/7/X/8，RT-DETR，单目标跟踪OSTrack、LightTrack。☆225Jun 12, 2024Updated last year
- Stable Diffusion in TensorRT 8.5+☆15Mar 19, 2023Updated 3 years ago
- ☆33Jul 23, 2024Updated last year
- ☆14Nov 3, 2025Updated 5 months ago
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.☆74Sep 8, 2024Updated last year
- A practical way of learning Swizzle☆37Feb 3, 2025Updated last year
- A tool convert TensorRT engine/plan to a fake onnx☆41Nov 22, 2022Updated 3 years ago
- segmentation algorithm yolact use tensorrt deploy☆14May 7, 2022Updated 3 years ago
- 搜藏的希望的代码片段☆13Jun 6, 2023Updated 2 years ago
- llm deploy project based onnx.☆50Oct 9, 2024Updated last year
- A CUDA kernel for NHWC GroupNorm for PyTorch☆23Nov 15, 2024Updated last year
- 将fast-livo视觉部分移植到faster-lio中，使用自适应体素的地图表征形式，最新版加入STD描述子检测回环并更新在分支fastlivo_voxel_std中☆109Feb 25, 2024Updated 2 years ago
- ☆18Dec 7, 2023Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- nanodet_rknn on rk3399pro platform☆17Apr 17, 2022Updated 3 years ago
- 使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention☆82Aug 12, 2024Updated last year
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆50Aug 16, 2023Updated 2 years ago
- chinese_LPR tensorrt☆69Mar 20, 2023Updated 3 years ago
- 10000 fps 🚀 for 360 Surround-View CUDA Solution☆148Dec 23, 2023Updated 2 years ago
- C++ TensorRT Implementation of NanoSAM☆51Dec 28, 2023Updated 2 years ago
- 跟着Tensorrt_pro学习各种知识☆39Nov 25, 2022Updated 3 years ago
- 高效部署：YOLO X, V3, V4, V5, V6, V7, V8, EdgeYOLO TRT推理 ™️ ,前后处理均由CUDA核函数实现 CPP/CUDA🚀☆54Feb 23, 2023Updated 3 years ago
- SAM and lama inpaint，包含QT的GUI交互界面，实现了交互式可实时显示结果的画点、画框进行SAM，然后通过进行Inpaint，具体操作看readme里的视频。☆53Jan 30, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Lanelet2 map tile generator tool for Autoware dynamic lanelet2 map loading.☆12Jun 24, 2024Updated last year
- SuperPoint-SuperGlue-TensorRT☆25Jan 17, 2025Updated last year
- apollo r3.0 感知移植（参考百度开发者套件）☆19Oct 29, 2019Updated 6 years ago
- ☆63Feb 15, 2026Updated 2 months ago
- ☆79May 16, 2023Updated 2 years ago
- 使用 CUDA C++ 实现的 llama 模型推理框架☆65Nov 8, 2024Updated last year
- One Diffusion model implementation base on LibTorch☆13Mar 22, 2023Updated 3 years ago