EdVince / llm-cpp
☆32Updated 7 months ago
Alternatives and similar repositories for llm-cpp:
Users that are interested in llm-cpp are comparing it to the libraries listed below
- some ncnn demos of FunASR☆23Updated 5 months ago
- ppstructure deploy by ncnn☆30Updated 8 months ago
- c++实现的clip推理，模型有一点点改动，但是不大，改动和导出模型的代码可以在readme里找到，模型文件都在Releases里，包括AX650的模型。新增支持ChineseCLIP☆29Updated 2 months ago
- ☆124Updated last year
- llm deploy project based onnx.☆31Updated 5 months ago
- stable diffusion using mnn☆65Updated last year
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆55Updated last week
- DragGan in NCNN with c++☆50Updated last year
- Whisper in TensorRT-LLM☆15Updated last year
- SAM and lama inpaint，包含QT的GUI交互界面，实现了交互式可实时显示结果的画点、画框进行SAM，然后通过进行Inpaint，具体操作看readme里的视频。☆46Updated last year
- NeRF in NCNN with c++ & vulkan☆67Updated last year
- a naive example of LivePortrait infer by ncnn☆41Updated 7 months ago
- A converter for llama2.c legacy models to ncnn models.☆87Updated last year
- segment-anything based mnn☆35Updated last year
- Run Chinese MobileBert model on SNPE.☆14Updated last year
- UIE(Universal Information Extraction) infer by ncnn☆12Updated 5 months ago
- mnn asr demo.☆13Updated 2 months ago
- an example of segment-anything infer by ncnn☆121Updated last year
- GPT2⚡NCNN⚡中文对话⚡x86⚡Android☆79Updated 2 years ago
- 使用onnxruntime部署实时视频帧插值，包含C++和Python两个版本的程序☆25Updated last year
- ncnn version of CodeFormer☆103Updated 2 years ago
- ncnn HiFi-GAN☆26Updated 5 months ago
- libvits-ncnn is an ncnn implementation of the VITS library that enables cross-platform GPU-accelerated speech synthesis.🎙️💻☆60Updated last year
- the C++ version of Transformer with ncnn☆19Updated 3 years ago
- A Toolkit to Help Optimize Onnx Model☆121Updated 3 weeks ago
- ☆23Updated 2 months ago
- ggml学习笔记，ggml是一个机器学习的推理框架☆14Updated 11 months ago
- qwen2 and llama3 cpp implementation☆43Updated 9 months ago
- Inference TinyLlama models on ncnn☆24Updated last year