A repo for llm on ncnn
☆254Oct 7, 2026Updated last month
Alternatives and similar repositories for ncnn_llm
Users that are interested in ncnn_llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- base on ncnn_llm build a ragsystem☆14Jan 16, 2026Updated 9 months ago
- Lightweight C++ runtime for Penguin-VL multimodal LLM on ncnn, with pnnx-based export pipeline and cross-platform deployment☆13Jul 29, 2026Updated 3 months ago
- 基于 ncnn 的 Stable Diffusion 推理小工具,用于给 ncnn-llm 适配“图片生成”能力(作为 MCP 工具/后端可执行程序被调用)。☆18Dec 19, 2025Updated 10 months ago
- 尝试作为手机助手植入到手机内运行的 ncnn llm☆17Dec 24, 2025Updated 10 months ago
- PPOCR v5/v6☆49Sep 27, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A repo for llm on ncnn☆15Jul 5, 2026Updated 4 months ago
- ☆21Oct 17, 2025Updated last year
- ncnn export & infer mobileclip☆20Aug 18, 2025Updated last year
- momoten is an experimental translation and runtime layer that implements a restricted, buffer-oriented subset of the Vulkan compute API o…☆27Updated this week
- A Deeplearn Model to rec table in photo with ncnn. 一个深度学习模型用于检测图片中的表格 画像内のテーブルを検出するためのディープラーニング モデル☆20Mar 2, 2025Updated last year
- A lightweight heterogeneous MoE inference runtime based on ncnn☆36Updated this week
- UIE(Universal Information Extraction) infer by ncnn☆15Sep 22, 2024Updated 2 years ago
- Using ncnn to test the reasoning performance of neural network☆39Jan 18, 2026Updated 9 months ago
- A DeepLearn Model to rec Math formula. 一个深度学习库用来识别数学公式 数式を識別するためのディープラーニング ライブラリ☆27Mar 2, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ncnn implementation of Z-Image image generater☆517Oct 30, 2026Updated last week
- YOLOE on ncnn☆15Aug 19, 2025Updated last year
- PyTorch Neural Network eXchange☆714Oct 30, 2026Updated last week
- Lightweight ncnn C API bindings for MicroPython☆13Dec 7, 2025Updated 11 months ago
- ncnn android robust video matting☆24Oct 27, 2026Updated last week
- C++ implementations of PP-OCRv3/4/5/6 using ncnn for inference.☆111Jun 20, 2026Updated 4 months ago
- ncnn和pnnx格式编辑器☆148Jul 15, 2026Updated 3 months ago
- 高性能 高精度 大陆车牌、港澳车牌、台湾车牌 韩国车牌(South Korea LPR)识别 代码开源(ncnn移植)☆50Nov 5, 2025Updated last year
- nikki is an experimental translation and runtime layer that implements a restricted, buffer-oriented subset of the Vulkan compute API ove…☆24Oct 27, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Vulkan Compute Pipeline Demo (Gaussian Blur/GEMM/Flash Attention2/...)☆11Jul 6, 2026Updated 4 months ago
- A converter for llama2.c legacy models to ncnn models.☆79Dec 17, 2023Updated 2 years ago
- ncnn android piper the fast and local neural text-to-speech engine☆72Oct 22, 2026Updated 2 weeks ago
- WeChat QRCode NCNN☆10Jul 11, 2026Updated 3 months ago
- ☆52May 27, 2026Updated 5 months ago
- ncnn implementation of Qwen-Image-2.1, with text-to-image, image editing, multi-reference image input and transparent RGBA output☆355Updated this week
- [AAAI2025] SUTrack: Towards Simple and Unified Single Object Tracking. Converter to onnx model file.☆18Apr 2, 2026Updated 7 months ago
- 一些有用的功能☆49Oct 23, 2026Updated 2 weeks ago
- an example of segment-anything infer by ncnn☆123May 5, 2023Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Palm on-device acceleration capabilities.☆81Oct 25, 2026Updated last week
- A focused, native macOS system monitor for your menu bar.☆42Updated this week
- ☆16Mar 24, 2025Updated last year
- 🥕 鸿蒙 ncnn 实现图片识别与摄像头实时 识别显示☆33Feb 7, 2025Updated last year
- A lightweight, production-ready C++ library for LLM tokenization, fully compatible with HuggingFace tokenizer.json.☆35Jan 4, 2026Updated 10 months ago
- NeRF in NCNN with c++ & vulkan☆68Jun 18, 2023Updated 3 years ago
- 使用NCNN推理框架和ByteTrack目标跟踪框架,对网络、文件流URL进行实时性视频推理,而UI界面则由Qt框架实现☆24Oct 16, 2024Updated 2 years ago