EdVince / llm-cppLinks
☆33Updated last year
Alternatives and similar repositories for llm-cpp
Users that are interested in llm-cpp are comparing it to the libraries listed below
Sorting:
- A converter for llama2.c legacy models to ncnn models.☆79Updated 2 years ago
- llm deploy project based onnx.☆48Updated last year
- NeRF in NCNN with c++ & vulkan☆68Updated 2 years ago
- ☆125Updated 2 years ago
- ppstructure deploy by ncnn☆34Updated last year
- some ncnn demos of FunASR☆28Updated last year
- Whisper in TensorRT-LLM☆17Updated 2 years ago
- c++实现的clip推理，模型有一点点改动，但是不大，改动和导出模型的代码可以在readme里找到，模型文件都在Releases里，包括AX650的模型。新增支持ChineseCLIP☆30Updated 6 months ago
- Inference TinyLlama models on ncnn☆24Updated 2 years ago
- DragGan in NCNN with c++☆52Updated 2 years ago
- Run Chinese MobileBert model on SNPE.☆15Updated 2 years ago
- SAM and lama inpaint，包含QT的GUI交互界面，实现了交互式可实时显示结果的画点、画框进行SAM，然后通过进行Inpaint，具体操作看readme里的视频。☆51Updated last year
- a naive example of LivePortrait infer by ncnn☆43Updated last year
- NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆43Updated 2 years ago
- UIE(Universal Information Extraction) infer by ncnn☆15Updated last year
- ggml学习笔记，ggml是一个机器学习的推理框架☆18Updated last year
- ☆43Updated 3 years ago
- ☆67Updated 3 years ago
- GPT2⚡NCNN⚡中文对话⚡x86⚡Android☆82Updated 3 years ago
- an example of segment-anything infer by ncnn☆124Updated 2 years ago
- stable diffusion using mnn☆67Updated 2 years ago
- ncnn version of CodeFormer☆110Updated 2 years ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆89Updated 3 weeks ago
- A breakdown of NCNN☆46Updated 5 years ago
- the C++ version of Seq2Seq with ncnn☆23Updated 4 years ago
- segment-anything based mnn☆36Updated 2 years ago
- 🛠 A lite C++ toolkit: contains 100+ Awesome AI models, support MNN, NCNN, TNN, ONNXRuntime and TensorRT. 🎉🎉☆25Updated 9 months ago
- qwen2 and llama3 cpp implementation☆49Updated last year
- ☆25Updated 4 years ago
- ncnn和pnnx格式编辑器☆137Updated last year