使用 Rust 语言重新实现 https://github.com/zjhellofss/KuiperInfer 和 https://github.com/zjhellofss/kuiperdatawhale 中的深度学习推理框架。
☆16Apr 9, 2024Updated last year
Alternatives and similar repositories for KuiperInfer_rs
Users that are interested in KuiperInfer_rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 自制基于C++的深度学习前向推理框架☆21Jun 4, 2023Updated 2 years ago
- YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现☆12Mar 5, 2025Updated last year
- ☆20Updated this week
- 基于 CUDA Driver API 的 cuda 运行时环境☆15Jul 30, 2025Updated 7 months ago
- 高性能 高精度 大陆车牌、港澳车牌、台湾车牌 韩国车牌(South Korea LPR)识别 代码开源(ncnn移植）☆41Nov 5, 2025Updated 4 months ago
- ☆22Dec 24, 2023Updated 2 years ago
- go design pattern source codes 《Go语言设计模式》配套代码☆19Apr 11, 2023Updated 2 years ago
- 使用 CUDA C++ 实现的 llama 模型推理框架☆63Nov 8, 2024Updated last year
- A repo for llm on ncnn☆206Mar 18, 2026Updated last week
- Multilingual neural TTS (6 languages: JA/EN/ZH/ES/FR/PT) — C++, C# (.NET), Rust, Python SDKs. VITS + Prosody, streaming, CUDA/CoreML/Dire…☆100Updated this week
- 大模型推理框架加速，让 LLM 飞起来☆24May 10, 2024Updated last year
- Hope this could be helpful when you're struggling with finding a suitable PhD/postDoc position.☆10Aug 14, 2023Updated 2 years ago
- MobileSAM のエンコーダー/デコーダーをONNXに変換し、推論するサンプル☆11Apr 11, 2024Updated last year
- 校招、秋招、春招、实习好项目，带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。☆512Oct 28, 2025Updated 4 months ago
- Converts CLIP models to ONNX☆10Jan 17, 2023Updated 3 years ago
- ☆314Oct 9, 2024Updated last year
- 《Learning Zig》中文翻译☆52Aug 24, 2024Updated last year
- 使用ONNXRuntime部署一种用于边缘检测的轻量级密集卷积神经网络LDC，包含C++和Python两个版本的程序☆10Apr 24, 2023Updated 2 years ago
- LDC: Lightweight Dense CNN for Edge DetectionのPythonでのONNX推論サンプル☆14May 6, 2023Updated 2 years ago
- UIE(Universal Information Extraction) infer by ncnn☆15Sep 22, 2024Updated last year
- introduce AI infra knowledges. 人工智能系统基础架构知识库☆16Jun 4, 2023Updated 2 years ago
- DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。☆10Jan 9, 2024Updated 2 years ago
- ☆10Jul 18, 2024Updated last year
- Welcome to the Flying-Handbook for FZU students☆14Jun 17, 2025Updated 9 months ago
- Using ncnn to test the reasoning performance of neural network☆38Jan 18, 2026Updated 2 months ago
- Unity specific customizations to Android's libunwind library☆16May 6, 2021Updated 4 years ago
- Code repo for the UAI 2023 paper "Learning To Invert: Simple Adaptive Attacks for Gradient Inversion in Federated Learning".☆16Jun 15, 2024Updated last year
- yolov5_obb C++ onnxruntime deployment☆10Mar 11, 2024Updated 2 years ago
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- Yolo26 model supports android deployment.☆29Jan 21, 2026Updated 2 months ago
- 🎉My Collections of CUDA Kernels~☆10Jun 25, 2024Updated last year
- Here is a final lab of Compiler in USTC, focusing on MLIR☆20Jan 29, 2021Updated 5 years ago
- 手摸手 美团 YOLOv6模型训练和TensorRT端到端部署方案教程☆33Jun 30, 2022Updated 3 years ago
- bilibili视频【CUDA 12.x 并行编程 入门(C++版)】配套代码☆34Aug 12, 2024Updated last year
- CUDA 8-bit Tensor Core Matrix Multiplication based on m16n16k16 WMMA API☆35Sep 15, 2023Updated 2 years ago
- Wallace and Dadda tree multiplier generator in vhdl and verilog☆13Mar 14, 2026Updated last week
- Distributed machine learning platform☆13Aug 20, 2015Updated 10 years ago
- This repository provides tutorial, which discusses running sample publisher and subscriber using multiple transports of point_cloud_trans…☆10Mar 17, 2026Updated last week
- lightNet (Object Detection and Semantic Segmentation) for ONNX and TensorRT☆16Jul 4, 2023Updated 2 years ago