ling0322 / libllmLinks
Efficient inference of large language models.
☆149Updated 4 months ago
Alternatives and similar repositories for libllm
Users that are interested in libllm are comparing it to the libraries listed below
Sorting:
- ncnn和pnnx格式编辑器☆137Updated last year
- A repo for llm on ncnn☆189Updated last week
- ☆125Updated 2 years ago
- Tiny C++ LLM inference implementation from scratch☆102Updated last week
- Detect CPU features with single-file☆443Updated this week
- A converter for llama2.c legacy models to ncnn models.☆79Updated 2 years ago
- Inference TinyLlama models on ncnn☆24Updated 2 years ago
- ncnn implementation of Z-Image image generater☆94Updated this week
- a simple general program language☆99Updated 3 weeks ago
- llm deploy project based onnx.☆49Updated last year
- ☆34Updated last year
- Make a minimal OpenCV runable on any where, WIP☆87Updated 3 years ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆90Updated this week
- ☆33Updated last year
- GPT2⚡NCNN⚡中文对话⚡x86⚡Android☆82Updated 3 years ago
- Infere RWKV on NCNN☆49Updated last year
- A Deeplearn Model to rec table in photo with ncnn. 一个深度学习模型用于检测图片中的表格 画像内のテーブルを検出するためのディープラーニング モデル☆20Updated 11 months ago
- ggml学习笔记，ggml是一个机器学习的推理框架☆18Updated last year
- An easy way to run, test, benchmark and tune OpenCL kernel files☆24Updated 2 years ago
- Explore LLM model deployment based on AXera's AI chips☆139Updated this week
- NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆43Updated 2 years ago
- Benchmark your NCNN models on 3DS(or crash)☆10Updated last year
- qwen2 and llama3 cpp implementation☆49Updated last year
- DragGan in NCNN with c++☆52Updated 2 years ago
- stable diffusion using mnn☆67Updated 2 years ago
- MegCC是一个运行时超轻量，高效，移植简单的深度学习模型编译器☆489Updated last year
- 关于自建AI推理引擎的手册，从0开始你需要知道的所有事情☆272Updated 3 years ago
- ☆26Updated 2 years ago
- This is a demo how to write a high performance convolution run on apple silicon☆57Updated 4 years ago
- ☆85Updated 2 years ago