☆34Jul 23, 2024Updated 2 years ago
Alternatives and similar repositories for llm-cpp
Users that are interested in llm-cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ppstructure deploy by ncnn☆36Jul 16, 2024Updated 2 years ago
- Inference TinyLlama models on ncnn☆24Aug 15, 2023Updated 3 years ago
- ncnn version of CodeFormer☆109Mar 9, 2023Updated 3 years ago
- NeRF in NCNN with c++ & vulkan☆68Jun 18, 2023Updated 3 years ago
- DragGan in NCNN with c++☆52Oct 5, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- an example of segment-anything infer by ncnn☆123May 5, 2023Updated 3 years ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆101Nov 3, 2026Updated 2 weeks ago
- Lightweight ncnn C API bindings for MicroPython☆13Dec 7, 2025Updated 11 months ago
- ncnn android robust video matting☆24Oct 27, 2026Updated 3 weeks ago
- UIE(Universal Information Extraction) infer by ncnn☆15Sep 22, 2024Updated 2 years ago
- A converter for llama2.c legacy models to ncnn models.☆79Dec 17, 2023Updated 2 years ago
- ☆14Dec 19, 2022Updated 3 years ago
- ☆86Mar 2, 2023Updated 3 years ago
- A Deeplearn Model to rec table in photo with ncnn. 一个深度学习模型用于检测图片中的表格 画像内のテーブルを検出するためのディープラーニング モデル☆20Mar 2, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A low latency, fault tolerant API for accessing LLM's written in C++ using llama.cpp.☆12Jun 14, 2025Updated last year
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆50Aug 16, 2023Updated 3 years ago
- Infere RWKV on NCNN☆49Sep 3, 2024Updated 2 years ago
- momoten is an experimental translation and runtime layer that implements a restricted, buffer-oriented subset of the Vulkan compute API o…☆27Nov 6, 2026Updated last week
- CLIP⚡NCNN⚡基于自然语言的图片搜索(Image Search)⚡以字搜图⚡x86⚡Android☆282Jul 12, 2023Updated 3 years ago
- A lightweight vLLM-style inference engine in Rust☆154Aug 28, 2026Updated 2 months ago
- 本仓库在OpenVINO推理框架下部署Nanodet检测算法,并重写预处理和后处理部分,具有超高性能!让你在Intel CPU平台上的检测速度起飞! 并基于NNCF和PPQ工具将模型量化(PTQ)至int8精度,推理速度更快!☆16Jun 14, 2023Updated 3 years ago
- HunyuanDiT with TensorRT and libtorch☆18May 22, 2024Updated 2 years ago
- An easy way to run, test, benchmark and tune OpenCL kernel files☆24Aug 25, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Recording models☆13Sep 19, 2023Updated 3 years ago
- GPT2⚡NCNN⚡中文对话⚡x86⚡Android☆82Mar 25, 2022Updated 4 years ago
- Export Qwen2 models to onnx.☆13Aug 12, 2024Updated 2 years ago
- Light weight Object detection on Nintendo 3DS, powered by NCNN☆13Apr 3, 2024Updated 2 years ago
- 🥕 鸿蒙 ncnn 实现图片识别与摄像头实时识别显示☆33Feb 7, 2025Updated last year
- The inference implementation of the deeplabV3+ person segementation algorithm.☆24Jan 1, 2021Updated 5 years ago
- 基于MNN-llm的安卓手机部署大语言模型:Qwen1.5-0.5B-Chat☆99Apr 8, 2024Updated 2 years ago
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- ☆18Dec 7, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- libvits-ncnn is an ncnn implementation of the VITS library that enables cross-platform GPU-accelerated speech synthesis.🎙️💻☆62May 6, 2023Updated 3 years ago
- 很好用的tnn classify demo☆11Mar 24, 2021Updated 5 years ago
- EasyNN是一个面向教学而开发的神经网络推理框架,旨在让大家0基础也能自主完成推理框架编写!☆41Aug 26, 2024Updated 2 years ago
- Stable Diffusion in TensorRT 8.5+☆14Mar 19, 2023Updated 3 years ago
- the C++ version of Seq2Seq with ncnn☆24Jun 27, 2021Updated 5 years ago
- [WIP] NCNN with Vulkan implementation of GFPGAN aims at developing Practical Algorithms for Real-world Face Restoration☆53Jun 24, 2026Updated 4 months ago
- ☆10May 14, 2024Updated 2 years ago
Are these results useful?