Header-only safetensors loader and saver in C++
☆78Dec 27, 2025Updated 2 months ago
Alternatives and similar repositories for safetensors-cpp
Users that are interested in safetensors-cpp are comparing it to the libraries listed below
Sorting:
- Zero Dependency LibTorch Safetensors Loading and Storing in C++☆23Jul 12, 2024Updated last year
- ggml学习笔记，ggml是一个机器学习的推理框架☆17Mar 24, 2024Updated last year
- HunyuanDiT with TensorRT and libtorch☆17May 22, 2024Updated last year
- Inference deployment of the llama3☆10Apr 21, 2024Updated last year
- A one-page-only CGraph-API-liked DAG project.☆25Feb 11, 2025Updated last year
- ☆27Jun 30, 2025Updated 8 months ago
- RKNN模型推理部署模板☆23Aug 11, 2023Updated 2 years ago
- llm deploy project based onnx.☆49Oct 9, 2024Updated last year
- ☆42Nov 29, 2022Updated 3 years ago
- A tool convert TensorRT engine/plan to a fake onnx☆40Nov 22, 2022Updated 3 years ago
- A simple and fast minimalistic header-only library allowing to run async tasks and execute task graphs.☆60Nov 29, 2024Updated last year
- A Triton JIT runtime and ffi provider in C++☆32Updated this week
- 基于 CUDA Driver API 的 cuda 运行时环境☆14Jul 30, 2025Updated 7 months ago
- nsfw & porn detection for mobile in ncnn☆11Dec 24, 2021Updated 4 years ago
- ☆17Jan 1, 2024Updated 2 years ago
- High Performan Ai Model Web Server. Mainly support computer vision model. Quickly establish your own ai-model server. https://github.com/…☆44May 13, 2025Updated 10 months ago
- Run Chinese MobileBert model on SNPE.☆14May 19, 2023Updated 2 years ago
- PiDiNet running in Android by ncnn☆15Sep 26, 2021Updated 4 years ago
- ncnn HiFi-GAN☆29Sep 29, 2024Updated last year
- Optix7 experiments☆10Oct 20, 2019Updated 6 years ago
- Recording models☆11Sep 19, 2023Updated 2 years ago
- C++ implementation of Qwen-LM☆619Dec 6, 2024Updated last year
- Inference Vision Transformer (ViT) in plain C/C++ with ggml☆310Apr 11, 2024Updated last year
- ☆33Feb 3, 2025Updated last year
- Large Language Model Onnx Inference Framework☆34Nov 25, 2025Updated 3 months ago
- run ChatGLM2-6B in BM1684X☆48Mar 1, 2024Updated 2 years ago
- A Python and C++ library for model encryption and decryption, built on Crypto++, with support for various deep learning frameworks includ…☆51Oct 27, 2023Updated 2 years ago
- Convert tflite to JSON and make it editable in the IDE. It also converts the edited JSON back to tflite binary.☆28Feb 21, 2023Updated 3 years ago
- Companion repository for the EUSIPCO-24 accepted paper "Pre-Training Music Classification Models via Music Source Separation"☆12Aug 30, 2024Updated last year
- C++数据流并行处理框架☆23Apr 10, 2021Updated 4 years ago
- ☆20Dec 29, 2023Updated 2 years ago
- This repo provides the C++ implementation of YOLO-NAS based on ONNXRuntime for performing object detection in real-time.Support float32/f…☆45Apr 1, 2024Updated last year
- ☆16Dec 7, 2023Updated 2 years ago
- A Deeplearn Model to rec table in photo with ncnn. 一个深度学习模型用于检测图片中的表格 画像内のテーブルを検出するためのディープラーニング モデル☆20Mar 2, 2025Updated last year
- ☆21Apr 10, 2024Updated last year
- A C++ port of karpathy/llm.c features a tiny torch library while maintaining overall simplicity.☆45Mar 2, 2026Updated 2 weeks ago
- 本仓库基于 Intel OpenVINO Toolkit 部署 LightTrack 跟踪算法，包含 Python、C++ 两种语言的推理代码.☆20Nov 2, 2023Updated 2 years ago
- cvitek ai compiler base on MLIR☆23Mar 14, 2022Updated 4 years ago
- RKNN-YOLOV5-BatchInference-MultiThreadingYOLOV5多张图片多线程C++推理☆21Nov 6, 2023Updated 2 years ago