☆34Jul 23, 2024Updated 2 years ago
Alternatives and similar repositories for llm-cpp
Users that are interested in llm-cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ppstructure deploy by ncnn☆36Jul 16, 2024Updated 2 years ago
- Inference TinyLlama models on ncnn☆24Aug 15, 2023Updated 3 years ago
- ☆16Mar 24, 2025Updated last year
- ncnn version of CodeFormer☆109Mar 9, 2023Updated 3 years ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆99Jul 27, 2026Updated 2 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- UIE(Universal Information Extraction) infer by ncnn☆15Sep 22, 2024Updated 2 years ago
- ncnn android robust video matting☆23May 27, 2026Updated 4 months ago
- DragGan in NCNN with c++☆52Oct 5, 2023Updated 3 years ago
- ☆14Dec 19, 2022Updated 3 years ago
- an example of segment-anything infer by ncnn☆123May 5, 2023Updated 3 years ago
- A lightweight vLLM-style inference engine in Rust☆154Aug 28, 2026Updated last month
- An easy way to run, test, benchmark and tune OpenCL kernel files☆24Aug 25, 2023Updated 3 years ago
- A converter for llama2.c legacy models to ncnn models.☆79Dec 17, 2023Updated 2 years ago
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初 赛第三名方案☆50Aug 16, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A Deeplearn Model to rec table in photo with ncnn. 一个深度学习模型用于检测图片中的表格 画像内のテーブルを検出するためのディープラーニング モデル☆20Mar 2, 2025Updated last year
- HunyuanDiT with TensorRT and libtorch☆18May 22, 2024Updated 2 years ago
- the C++ version of Seq2Seq with ncnn☆24Jun 27, 2021Updated 5 years ago
- Light weight Object detection on Nintendo 3DS, powered by NCNN☆13Apr 3, 2024Updated 2 years ago
- ☆86Mar 2, 2023Updated 3 years ago
- The inference implementation of the deeplabV3+ person segementation algorithm.☆24Jan 1, 2021Updated 5 years ago
- c# library for decoding K2 transducer Models，used in speech recognition (ASR)☆13Aug 20, 2025Updated last year
- libvits-ncnn is an ncnn implementation of the VITS library that enables cross-platform GPU-accelerated speech synthesis.🎙️💻☆62May 6, 2023Updated 3 years ago
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- GPT2⚡NCNN⚡中文对话⚡x86⚡Android☆82Mar 25, 2022Updated 4 years ago
- Infere RWKV on NCNN☆49Sep 3, 2024Updated 2 years ago
- SAM and lama inpaint，包含QT的GUI交互界面，实现了交互式可实时显示结果的画点、画框进行SAM，然后通过进行Inpaint，具体操作看readme里的视频。☆54Jan 30, 2024Updated 2 years ago
- Stable Diffusion in TensorRT 8.5+☆14Mar 19, 2023Updated 3 years ago
- The rknn2 API uses the secondary encapsulation of the process, which is easy for everyone to call. It is applicable to rk356x rk3588☆47Jun 18, 2022Updated 4 years ago
- ☆68Jul 26, 2025Updated last year
- the photo picker library of android☆12May 9, 2016Updated 10 years ago
- a light lib of android-common-utils for use.☆12May 16, 2019Updated 7 years ago
- ncnn android paddle ocr v5☆201May 27, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆14Nov 3, 2025Updated 11 months ago
- a naive example of LivePortrait infer by ncnn☆47Aug 7, 2024Updated 2 years ago
- ☆75Sep 8, 2022Updated 4 years ago
- This repository contains the dataset used to train the neural network model descried in the paper "Implicit HRTF Modeling Using Tempora…☆11Aug 4, 2023Updated 3 years ago
- Privacy-first real-time face mask detection in the browser using YOLO-Fastest, NCNN, C++, and WebAssembly.☆29Jul 28, 2026Updated 2 months ago
- 测试桌面端ncnn c++算法☆17Jun 15, 2025Updated last year
- An ASR toolkit with the freedom of topology☆10Dec 18, 2023Updated 2 years ago