Alternatives and similar repositories for Toucan-LLM

Users that are interested in Toucan-LLM are comparing it to the libraries listed below

• Arm-China / Model_zoo
  Zhouyi model zoo
  ☆104Updated last month
• nihui / ncnn_on_esp32
  ☆80Updated last year
• airockchip / rknpu_ddk
  DDK for Rockchip NPU
  ☆69Updated 4 years ago
• AXERA-TECH / ax-llm
  Explore LLM model deployment based on AXera's AI chips
  ☆130Updated this week
• mtx512 / v831-npu
  Reverse engineering the V831 npu
  ☆95Updated 4 years ago
• scarsty / ncnn-editor
  ncnn和pnnx格式编辑器
  ☆137Updated last year
• nihui / riscv-v-toolchain
  prebuild package for cross compiling riscv
  ☆17Updated 3 years ago
• alohali / benchmark-models
  benchmark models for TNN, ncnn, MNN
  ☆20Updated 5 years ago
• sipeed / axpi_bsp_sdk
  linux bsp app & sample for axpi (ax620a)
  ☆36Updated 2 years ago
• hisrg / SNPE
  Snapdragon Neural Processing Engine (SNPE) SDKThe Snapdragon Neural Processing Engine (SNPE) is a Qualcomm Snapdragon software accelerate…
  ☆35Updated 3 years ago
• nihui / ncnn-small-board
  ncnn benchmark on various single board computers
  ☆162Updated 2 years ago
• ling0322 / libllm
  Efficient inference of large language models.
  ☆151Updated 2 months ago
• lrw04 / tinyllamas-ncnn
  Inference TinyLlama models on ncnn
  ☆24Updated 2 years ago
• lrw04 / llama2.c-to-ncnn
  A converter for llama2.c legacy models to ncnn models.
  ☆80Updated last year
• corleonechensiyu / tinyCNN
  将MNN拆解的简易前向推理框架(for study!)
  ☆23Updated 4 years ago
• microsoft / onnxruntime-tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆35Updated 3 years ago
• XUANTIE-RV / csi-nn2
  An optimized neural network operator library for chips base on Xuantie CPU.
  ☆96Updated last year
• OAID / TengineInferPipe
  ☆24Updated 3 years ago
• EdVince / GPT2-ChineseChat-NCNN
  GPT2⚡NCNN⚡中文对话⚡x86⚡Android
  ☆82Updated 3 years ago
• daquexian / faster-rwkv
  ☆125Updated last year
• AXERA-TECH / ax650n_bsp_sdk
  linux bsp app & sample for axpi pro (ax650n)
  ☆30Updated last year
• OAID / Tengine-Convert-Tools
  Tengine Convert Tool supports converting multi framworks' models into tmfile that suitable for Tengine-Lite AI framework.
  ☆92Updated 4 years ago
• keith2018 / TinyGPT
  Tiny C++ LLM inference implementation from scratch
  ☆95Updated this week
• sophgo / tpu_compiler
  cvitek ai compiler base on MLIR
  ☆23Updated 3 years ago
• Oneflow-Inc / oneflow-lite
  ☆18Updated last year
• Abandon-ht / m3axpi_model
  ☆24Updated 2 years ago
• AXERA-TECH / ax-pipeline
  The Pipeline example based on AX650N/AX8850 shows the software development skills of Image Processing, NPU, Codec, and Display modules, …
  ☆12Updated 3 months ago
• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆16Updated 2 years ago
• DayBreak-u / seq2seq_ncnn
  the C++ version of Seq2Seq with ncnn
  ☆23Updated 4 years ago
• VeriSilicon / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆10Updated 3 years ago