使用 Rust 语言重新实现 https://github.com/zjhellofss/KuiperInfer 和 https://github.com/zjhellofss/kuiperdatawhale 中的深度学习推理框架。
☆17Apr 9, 2024Updated 2 years ago
Alternatives and similar repositories for KuiperInfer_rs
Users that are interested in KuiperInfer_rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 自制基于C++的深度学习前向推理框架☆21Jun 4, 2023Updated 2 years ago
- YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现☆13Mar 5, 2025Updated last year
- ☆29Updated this week
- 基于 CUDA Driver API 的 cuda 运行时环境☆16Jul 30, 2025Updated 9 months ago
- FractionalTransforms.jl: A Julia package aiming at providing fractional order transforms with high performance.☆16Jul 15, 2022Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- arok ui☆10Jun 20, 2023Updated 2 years ago
- 使用 CUDA C++ 实现的 llama 模型推理框架☆65Nov 8, 2024Updated last year
- A C++ library for parsing and HLS playlists and demuxing Transport Streams☆11Aug 23, 2022Updated 3 years ago
- A repo for llm on ncnn☆224Apr 3, 2026Updated last month
- 大模型推理框架加速,让 LLM 飞起来☆24May 10, 2024Updated 2 years ago
- 演讲《GPU 驱动的发行版适配》☆11Mar 18, 2024Updated 2 years ago
- Obtain options data from Interactive Brokers (IBKR) API