kendryte / Toucan-LLMLinks
Self-trained Large Language Models based on Meta LLaMa
☆30Updated 2 years ago
Alternatives and similar repositories for Toucan-LLM
Users that are interested in Toucan-LLM are comparing it to the libraries listed below
Sorting:
- ☆79Updated last year
- prebuild package for cross compiling riscv☆18Updated 3 years ago
- Zhouyi model zoo☆101Updated 2 months ago
- Inference TinyLlama models on ncnn☆24Updated 2 years ago
- 将MNN拆解的简易前向推理框架(for study!)☆23Updated 4 years ago
- GPT2⚡NCNN⚡中文对话⚡x86⚡Android☆80Updated 3 years ago
- ncnn和pnnx格式编辑器☆137Updated 10 months ago
- Kendryte K510 Documents☆41Updated 2 years ago
- linux bsp app & sample for axpi (ax620a)☆35Updated 2 years ago
- ☆125Updated last year
- A converter for llama2.c legacy models to ncnn models.☆81Updated last year
- Reverse engineering the V831 npu☆94Updated 4 years ago
- ☆15Updated 3 years ago
- the C++ version of Seq2Seq with ncnn☆23Updated 4 years ago
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆34Updated 2 years ago
- Efficient inference of large language models.☆151Updated last week
- ncnn benchmark on various single board computers☆163Updated last year
- Explore LLM model deployment based on AXera's AI chips☆110Updated last week
- Tengine Convert Tool supports converting multi framworks' models into tmfile that suitable for Tengine-Lite AI framework.☆93Updated 4 years ago
- benchmark models for TNN, ncnn, MNN☆20Updated 5 years ago
- Snapdragon Neural Processing Engine (SNPE) SDKThe Snapdragon Neural Processing Engine (SNPE) is a Qualcomm Snapdragon software accelerate…☆34Updated 3 years ago
- An optimized neural network operator library for chips base on Xuantie CPU.☆92Updated last year
- ☆24Updated 2 years ago
- DDK for Rockchip NPU☆66Updated 4 years ago
- Acuitylite is an end-to-end neural network deployment tool☆18Updated last month
- Sophgo AI chips driver and runtime library.☆22Updated 2 weeks ago
- Whisper in TensorRT-LLM☆16Updated last year
- ☆23Updated 2 years ago
- Infere RWKV on NCNN☆49Updated 11 months ago
- Nuclei AI Library Optimized For RISC-V Vector☆13Updated 8 months ago