syoyo / safetensors-cppView external linksLinks
Header-only safetensors loader and saver in C++
☆78Dec 27, 2025Updated last month
Alternatives and similar repositories for safetensors-cpp
Users that are interested in safetensors-cpp are comparing it to the libraries listed below
Sorting:
- ☆10Jul 18, 2024Updated last year
- Zero Dependency LibTorch Safetensors Loading and Storing in C++☆23Jul 12, 2024Updated last year
- C++ implementation of tokenizers, including tiktoken.☆25Dec 7, 2023Updated 2 years ago
- ☆23Jan 3, 2024Updated 2 years ago
- Inference deployment of the llama3☆11Apr 21, 2024Updated last year
- Optix7 experiments☆10Oct 20, 2019Updated 6 years ago
- MobileSAM のエンコーダー/デコーダーをONNXに変換し、推論するサンプル☆12Apr 11, 2024Updated last year
- A one-page-only CGraph-API-liked DAG project.☆26Feb 11, 2025Updated last year
- llm deploy project based onnx.☆49Oct 9, 2024Updated last year
- ☆28Jun 30, 2025Updated 7 months ago
- snpe tutorial☆10Dec 25, 2023Updated 2 years ago
- Dockerfiles for poetry/mlc-llm(rk3588)/...☆10Sep 13, 2023Updated 2 years ago
- High Performan Ai Model Web Server. Mainly support computer vision model. Quickly establish your own ai-model server. https://github.com/…☆45May 13, 2025Updated 9 months ago
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- Recording models☆12Sep 19, 2023Updated 2 years ago
- A Deeplearn Model to rec table in photo with ncnn. 一个深度学习模型用于检测图片中的表格 画像内のテーブルを検出するためのディープラーニング モデル☆20Mar 2, 2025Updated 11 months ago
- 大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标☆20Sep 12, 2024Updated last year
- Run Chinese MobileBert model on SNPE.☆15May 19, 2023Updated 2 years ago
- 瑞芯微芯片的rknn推理框架部署(yolo模型)☆14Jul 17, 2025Updated 6 months ago
- 基于 CUDA Driver API 的 cuda 运行时环境☆15Jul 30, 2025Updated 6 months ago
- Large Language Model Onnx Inference Framework☆35Nov 25, 2025Updated 2 months ago
- transformer tokenizers (e.g. BERT tokenizer) in C++ (WIP)☆18Apr 7, 2022Updated 3 years ago
- ☆42Nov 29, 2022Updated 3 years ago
- The CPP version of Silero VAD: pre-trained enterprise-grade Voice Activity Detector☆23May 11, 2024Updated last year
- 算子库☆17Jul 9, 2025Updated 7 months ago
- This repo provides the C++ implementation of YOLO-NAS based on ONNXRuntime for performing object detection in real-time.Support float32/f…☆46Apr 1, 2024Updated last year
- 本仓库基于 Intel OpenVINO Toolkit 部署 LightTrack 跟踪算法，包含 Python、C++ 两种语言的推理代码.☆21Nov 2, 2023Updated 2 years ago
- A Python and C++ library for model encryption and decryption, built on Crypto++, with support for various deep learning frameworks includ…☆49Oct 27, 2023Updated 2 years ago
- ☆20Dec 29, 2023Updated 2 years ago
- ONNX-compatible DocShadow: High-Resolution Document Shadow Removal. Supports TensorRT 🚀☆24Sep 13, 2023Updated 2 years ago
- Inference Vision Transformer (ViT) in plain C/C++ with ggml☆306Apr 11, 2024Updated last year
- RKNN-YOLOV5-BatchInference-MultiThreadingYOLOV5多张图片多线程C++推理☆22Nov 6, 2023Updated 2 years ago
- 基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat☆89Apr 8, 2024Updated last year
- C++数据流并行处理框架☆23Apr 10, 2021Updated 4 years ago
- ☆152Jan 9, 2025Updated last year
- Universal cross-platform tokenizers binding to HF and sentencepiece☆452Jan 23, 2026Updated 3 weeks ago
- C++20 inference for Spotify's basic-pitch AMT/MIDI generator model with ONNXRuntime and libremidi☆31Oct 31, 2024Updated last year
- AIInfra 和 AISystem开源课程项目☆37Jun 22, 2025Updated 7 months ago
- Python scripts performing Open Vocabulary Object Detection using the YOLO-World model in ONNX.☆62Apr 7, 2024Updated last year