futz12 / ncnn_llmLinks
A repo for llm on ncnn
☆60Updated this week
Alternatives and similar repositories for ncnn_llm
Users that are interested in ncnn_llm are comparing it to the libraries listed below
Sorting:
- A converter for llama2.c legacy models to ncnn models.☆80Updated last year
- A Deeplearn Model to rec table in photo with ncnn. 一个深度学习模型用于检测图片中的表格 画像内のテーブルを検出するためのディープラーニング モデル☆19Updated 9 months ago
- ☆84Updated 2 years ago
- ☆125Updated last year
- ☆42Updated 3 years ago
- stable diffusion using mnn☆67Updated 2 years ago
- llm deploy project based onnx.☆47Updated last year
- Efficient inference of large language models.☆151Updated 2 months ago
- an example of segment-anything infer by ncnn☆125Updated 2 years ago
- ncnn export & infer mobileclip☆18Updated 3 months ago
- DragGan in NCNN with c++☆52Updated 2 years ago
- GPT2⚡NCNN⚡中文对话⚡x86⚡Android☆82Updated 3 years ago
- c++实现的clip推理,模型有一点点改动,但是不大,改动和导出模型的代码可以在readme里找到,模型文件都在Releases里,包括AX650的模型。新增支持ChineseCLIP☆30Updated 5 months ago
- NeRF in NCNN with c++ & vulkan☆68Updated 2 years ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆88Updated last month
- Detect CPU features with single-file☆435Updated last week
- A Toolkit to Help Optimize Large Onnx Model☆162Updated last month
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆43Updated 2 years ago
- A DeepLearn Model to rec Math formula. 一个深度学习库用来识别数学公式 数式を識別するためのディープラーニング ライブラリ☆25Updated 9 months ago
- linux bsp app & sample for axpi (ax620a)☆36Updated 2 years ago
- ☆33Updated last year
- SAM and lama inpaint,包含QT的GUI交互界面,实现了交互式可实时显示结果的画点、画框进行SAM,然后通过进行Inpaint,具体操作看readme里的视频。☆51Updated last year
- ☆10Updated last year
- the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml…☆35Updated 4 months ago
- Inference RWKV with multiple supported backends.☆70Updated this week
- Tencent NCNN with added CUDA support☆71Updated 4 years ago
- ppstructure deploy by ncnn☆33Updated last year
- Large Language Model Onnx Inference Framework☆36Updated last week
- UIE(Universal Information Extraction) infer by ncnn☆13Updated last year
- Header-only safetensors loader and saver in C++☆72Updated 6 months ago