ling0322 / libllm
Efficient inference of large language models.
☆137Updated last week
Related projects: ⓘ
- Detect CPU features with single-file☆277Updated this week
- ☆123Updated 9 months ago
- ncnn和pnnx格式编辑器☆123Updated last year
- A converter for llama2.c legacy models to ncnn models.☆82Updated 9 months ago
- Inference TinyLlama models on ncnn☆25Updated last year
- 分层解耦的深度学习推理引擎☆58Updated 3 weeks ago
- ☆27Updated last month
- GPT2⚡NCNN⚡中文对话⚡x86⚡Android☆79Updated 2 years ago
- Benchmark your NCNN models on 3DS(or crash)☆9Updated 5 months ago
- a program language for AI infrastructure☆85Updated this week
- stable diffusion using mnn☆58Updated 11 months ago
- Make a minimal OpenCV runable on any where, WIP☆80Updated last year
- NeRF in NCNN with c++ & vulkan☆66Updated last year
- Infere RWKV on NCNN☆47Updated 2 weeks ago
- cpp syntactic sugar☆8Updated 3 weeks ago
- Tiny C++11 GPT-2 inference implementation from scratch☆43Updated 8 months ago