☆33Jul 23, 2024Updated last year
Alternatives and similar repositories for llm-cpp
Users that are interested in llm-cpp are comparing it to the libraries listed below
Sorting:
- ppstructure deploy by ncnn☆35Jul 16, 2024Updated last year
- Inference TinyLlama models on ncnn☆24Aug 15, 2023Updated 2 years ago
- UIE(Universal Information Extraction) infer by ncnn☆15Sep 22, 2024Updated last year
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆90Feb 14, 2026Updated 2 weeks ago
- 🥕 鸿蒙 ncnn 实现图片识别与摄像头实时识别显示☆29Feb 7, 2025Updated last year
- ☆16Mar 24, 2025Updated 11 months ago
- ncnn version of CodeFormer☆110Mar 9, 2023Updated 2 years ago
- 本仓库在OpenVINO推理框架下部署Nanodet检测算法，并重写预处理和后处理部分，具有超高性能！让你在Intel CPU平台上的检测速度起飞！ 并基于NNCF和PPQ工具将模型量化(PTQ)至int8精度，推理速度更快！☆16Jun 14, 2023Updated 2 years ago
- HunyuanDiT with TensorRT and libtorch☆18May 22, 2024Updated last year
- An easy way to run, test, benchmark and tune OpenCL kernel files☆24Aug 25, 2023Updated 2 years ago
- A converter for llama2.c legacy models to ncnn models.☆79Dec 17, 2023Updated 2 years ago
- Efficient inference of large language models.☆149Sep 28, 2025Updated 5 months ago
- an example of segment-anything infer by ncnn☆124May 5, 2023Updated 2 years ago
- CLIP⚡NCNN⚡基于自然语言的图片搜索(Image Search)⚡以字搜图⚡x86⚡Android☆281Jul 12, 2023Updated 2 years ago
- 🎉My Collections of CUDA Kernels~☆11Jun 25, 2024Updated last year
- 很好用的tnn classify demo☆11Mar 24, 2021Updated 4 years ago
- ☆15Jun 8, 2021Updated 4 years ago
- The inference implementation of the deeplabV3+ person segementation algorithm.☆24Jan 1, 2021Updated 5 years ago
- The rknn2 API uses the secondary encapsulation of the process, which is easy for everyone to call. It is applicable to rk356x rk3588☆48Jun 18, 2022Updated 3 years ago
- c# library for decoding K2 transducer Models，used in speech recognition (ASR)☆13Aug 20, 2025Updated 6 months ago
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆50Aug 16, 2023Updated 2 years ago
- This repository contains the dataset used to train the neural network model descried in the paper "Implicit HRTF Modeling Using Tempora…☆11Aug 4, 2023Updated 2 years ago
- An ASR toolkit with the freedom of topology☆10Dec 18, 2023Updated 2 years ago
- DragGan in NCNN with c++☆52Oct 5, 2023Updated 2 years ago
- SAM and lama inpaint，包含QT的GUI交互界面，实现了交 互式可实时显示结果的画点、画框进行SAM，然后通过进行Inpaint，具体操作看readme里的视频。☆52Jan 30, 2024Updated 2 years ago
- ☆85Mar 2, 2023Updated 2 years ago
- ☆30Nov 16, 2024Updated last year
- Infere RWKV on NCNN☆49Sep 3, 2024Updated last year
- GPT2⚡NCNN⚡中文对话⚡x86⚡Android☆82Mar 25, 2022Updated 3 years ago
- Aligntune : A Modular Toolkit for Post Training Alignment of LLMs☆33Updated this week
- ☆14Nov 3, 2025Updated 3 months ago
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- This project provides simple code and demonstrates how to use the TensorRT C++ API and ONNX to deploy PaddleOCR text recognition model.☆51Aug 5, 2022Updated 3 years ago
- EasyNN是一个面向教学而开发的神经网络推理框架，旨在让大家0基础也能自主完成推理框架编写！☆37Aug 26, 2024Updated last year
- ☆14Dec 19, 2022Updated 3 years ago
- ☆12Dec 16, 2021Updated 4 years ago
- A Deeplearn Model to rec table in photo with ncnn. 一个深度学习模型用于检测图片中的表格 画像内のテーブルを検出するためのディープラーニング モデル☆20Mar 2, 2025Updated 11 months ago
- Light weight Object detection on Nintendo 3DS, powered by NCNN☆14Apr 3, 2024Updated last year
- Pytorch implementation of an Hourglass network for corner detection of a wrinkled towel.☆14Nov 30, 2020Updated 5 years ago