kendryte / Toucan-LLMLinks
Self-trained Large Language Models based on Meta LLaMa
☆30Updated last year
Alternatives and similar repositories for Toucan-LLM
Users that are interested in Toucan-LLM are comparing it to the libraries listed below
Sorting:
- prebuild package for cross compiling riscv☆18Updated 3 years ago
- Kendryte K510 Documents☆41Updated 2 years ago
- ☆77Updated last year
- DDK for Rockchip NPU☆63Updated 4 years ago
- Zhouyi model zoo☆98Updated 8 months ago
- A converter for llama2.c legacy models to ncnn models.☆87Updated last year
- Tengine Convert Tool supports converting multi framworks' models into tmfile that suitable for Tengine-Lite AI framework.☆93Updated 3 years ago
- Inference TinyLlama models on ncnn☆24Updated last year
- An optimized neural network operator library for chips base on Xuantie CPU.☆89Updated 11 months ago
- Explore LLM model deployment based on AXera's AI chips☆103Updated this week
- benchmark models for TNN, ncnn, MNN☆20Updated 4 years ago
- linux bsp app & sample for axpi pro (ax650n)☆25Updated 6 months ago
- linux bsp app & sample for axpi (ax620a)☆34Updated last year
- Benchmark your NCNN models on 3DS(or crash)☆10Updated last year
- 将MNN拆解的简易前向推理框架(for study!)☆22Updated 4 years ago
- ncnn和pnnx格式编辑器☆133Updated 7 months ago
- ncnn benchmark on various single board computers☆160Updated last year
- Reverse engineering the V831 npu☆93Updated 3 years ago
- ☆15Updated 3 years ago
- Kendryte K510 SDK☆121Updated last year
- cvitek ai compiler base on MLIR☆21Updated 3 years ago
- ☆123Updated last year
- the C++ version of Seq2Seq with ncnn☆23Updated 3 years ago
- ☆24Updated 2 years ago
- 使用NCNN推理框架和ByteTrack目标跟踪框架,对网络、文件流URL进行实时性视频推理,而UI界面则由Qt框架实现☆21Updated 7 months ago
- a program language for AI infrastructure☆88Updated this week
- Infere RWKV on NCNN☆48Updated 9 months ago
- a lightweight deep learning framework for CSK60XX serial products☆25Updated 11 months ago
- Sophgo AI chips driver and runtime library.☆21Updated this week
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆33Updated 2 years ago