kendryte / Toucan-LLMLinks
Self-trained Large Language Models based on Meta LLaMa
☆30Updated last year
Alternatives and similar repositories for Toucan-LLM
Users that are interested in Toucan-LLM are comparing it to the libraries listed below
Sorting:
- Zhouyi model zoo☆101Updated 2 months ago
- prebuild package for cross compiling riscv☆18Updated 3 years ago
- 将MNN拆解的简易前向推理框架(for study!)☆23Updated 4 years ago
- ☆77Updated last year
- Reverse engineering the V831 npu☆94Updated 4 years ago
- ncnn benchmark on various single board computers☆161Updated last year
- Inference TinyLlama models on ncnn☆24Updated last year
- Explore LLM model deployment based on AXera's AI chips☆109Updated 3 weeks ago
- linux bsp app & sample for axpi (ax620a)☆35Updated 2 years ago
- Efficient inference of large language models.☆149Updated last month
- ncnn和pnnx格式编辑器☆136Updated 9 months ago
- ☆15Updated 3 years ago
- An optimized neural network operator library for chips base on Xuantie CPU.☆92Updated last year
- DDK for Rockchip NPU☆65Updated 4 years ago
- GPT2⚡NCNN⚡中文对话⚡x86⚡Android☆80Updated 3 years ago
- ☆24Updated 2 years ago
- Kendryte K510 Documents☆41Updated 2 years ago
- A converter for llama2.c legacy models to ncnn models.☆81Updated last year
- benchmark models for TNN, ncnn, MNN☆20Updated 5 years ago
- Tengine Convert Tool supports converting multi framworks' models into tmfile that suitable for Tengine-Lite AI framework.☆93Updated 4 years ago
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆34Updated 2 years ago
- cvitek ai compiler base on MLIR☆22Updated 3 years ago
- linux bsp app & sample for axpi pro (ax650n)☆27Updated 8 months ago
- the C++ version of Seq2Seq with ncnn☆23Updated 4 years ago
- Tencent NCNN with added CUDA support☆69Updated 4 years ago
- a simple general program language☆97Updated this week
- Run generative AI models in sophgo BM1684X/BM1688☆231Updated last week
- autoTVM神经网络推理代码优化搜索演示,基于tvm编译开源模型centerface,并使用autoTVM搜索最优推理代码, 最终部署编译为c++代码,演示平台是cuda,可以是其他平台,例如树莓派,安卓手机,苹果手机.Thi is a demonstration of …☆27Updated 4 years ago
- ☆124Updated last year
- Benchmark your NCNN models on 3DS(or crash)☆10Updated last year