ling0322 / libllmLinks
Efficient inference of large language models.
☆149Updated last month
Alternatives and similar repositories for libllm
Users that are interested in libllm are comparing it to the libraries listed below
Sorting:
- ncnn和pnnx格式编辑器☆136Updated 9 months ago
- ☆124Updated last year
- Detect CPU features with single-file☆415Updated this week
- Tiny C++11 GPT-2 inference implementation from scratch☆62Updated 3 weeks ago
- A converter for llama2.c legacy models to ncnn models.☆81Updated last year
- Inference TinyLlama models on ncnn☆24Updated last year
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆77Updated 3 weeks ago
- Infere RWKV on NCNN☆48Updated 11 months ago
- GPT2⚡NCNN⚡中文对话⚡x86⚡Android☆80Updated 3 years ago
- a simple general program language☆97Updated this week
- Make a minimal OpenCV runable on any where, WIP☆84Updated 2 years ago
- ☆32Updated last year
- llm deploy project based onnx.☆42Updated 9 months ago
- ☆41Updated 2 years ago
- CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…☆169Updated this week
- 将MNN拆解的简易前向推理框架(for study!)☆23Updated 4 years ago
- 可在浏览器和微信小程序中使用的人脸识别算法. This is a WASM implementation of the Retinaface face detection algorithm.☆48Updated 7 months ago
- Benchmark your NCNN models on 3DS(or crash)☆10Updated last year
- 关于自建AI推理引擎的手册,从0开始你需要知道的所有事情☆267Updated 2 years ago
- cpp syntactic sugar☆8Updated last month
- ☆32Updated 10 months ago
- qwen2 and llama3 cpp implementation☆45Updated last year
- stable diffusion using mnn☆66Updated last year
- 分层解耦的深度学习推理引擎☆74Updated 5 months ago
- ggml学习笔记,ggml是一个机器学习的推理框架☆17Updated last year
- Explore LLM model deployment based on AXera's AI chips☆109Updated 3 weeks ago
- MegCC是一个运行时超轻量,高效,移植简单的深度学习模型编译器☆486Updated 9 months ago
- CPU inference for the DeepSeek family of large language models in C++☆308Updated 2 months ago
- This is a demo how to write a high performance convolution run on apple silicon☆54Updated 3 years ago
- A Deeplearn Model to rec table in photo with ncnn. 一个深度学习模型用于检测图片中的表格 画像内のテーブルを検出するためのディープラーニング モデル☆20Updated 5 months ago