Alternatives and similar repositories for Toucan-LLM:

Users that are interested in Toucan-LLM are comparing it to the libraries listed below

• Arm-China / Model_zoo
  Zhouyi model zoo
  ☆94Updated 5 months ago
• kendryte / k510_docs
  Kendryte K510 Documents
  ☆40Updated last year
• nihui / ncnn_on_esp32
  ☆75Updated 10 months ago
• nihui / riscv-v-toolchain
  prebuild package for cross compiling riscv
  ☆18Updated 3 years ago
• airockchip / rknpu_ddk
  DDK for Rockchip NPU
  ☆61Updated 4 years ago
• sipeed / axpi_bsp_sdk
  linux bsp app & sample for axpi (ax620a)
  ☆34Updated last year
• XUANTIE-RV / csi-nn2
  An optimized neural network operator library for chips base on Xuantie CPU.
  ☆87Updated 8 months ago
• sophgo / tpu_compiler
  cvitek ai compiler base on MLIR
  ☆20Updated 2 years ago
• mtx512 / v831-npu
  Reverse engineering the V831 npu
  ☆92Updated 3 years ago
• OAID / TengineInferPipe
  ☆24Updated 2 years ago
• lrw04 / llama2.c-to-ncnn
  A converter for llama2.c legacy models to ncnn models.
  ☆87Updated last year
• AXERA-TECH / ax-llm
  Explore LLM model deployment based on AXera's AI chips
  ☆85Updated 3 weeks ago
• Deepdive543443 / Benchncnn-3DS
  Benchmark your NCNN models on 3DS(or crash)
  ☆9Updated 10 months ago
• XUANTIE-RV / tvm
  TVM for chips base on Xuantie CPU, an open deep learning compiler stack.
  ☆30Updated 8 months ago
• lrw04 / tinyllamas-ncnn
  Inference TinyLlama models on ncnn
  ☆24Updated last year
• xmos / lib_tflite_micro
  ☆11Updated last week
• alohali / benchmark-models
  benchmark models for TNN, ncnn, MNN
  ☆20Updated 4 years ago
• microsoft / onnxruntime-tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆34Updated 2 years ago
• kendryte / k510_buildroot
  Kendryte K510 SDK
  ☆119Updated last year
• kendryte / K230_training_scripts
  ☆38Updated 3 months ago
• OAID / Tengine-Convert-Tools
  Tengine Convert Tool supports converting multi framworks' models into tmfile that suitable for Tengine-Lite AI framework.
  ☆92Updated 3 years ago
• daquexian / faster-rwkv
  ☆124Updated last year
• sophgo / LLM-TPU
  Run generative AI models in sophgo BM1684X
  ☆180Updated this week
• Arm-China / Compass_Optimizer
  Compass Optimizer (OPT for short), is part of the Zhouyi Compass Neural Network Compiler. The OPT is designed for converting the float In…
  ☆25Updated 2 months ago
• WuDan0399 / Integrate-NVDLA-and-TVM
  ☆29Updated 2 years ago
• atanmarko / ncnn-with-cuda
  Tencent NCNN with added CUDA support
  ☆69Updated 4 years ago
• soDLA-publishment / somnia
  Learn NVDLA by SOMNIA
  ☆33Updated 5 years ago
• scarsty / ncnn-editor
  ncnn和pnnx格式编辑器
  ☆130Updated 5 months ago
• JunningWu / AIChip
  Aiming at an AI Chip based on RISC-V and NVDLA.
  ☆20Updated 7 years ago
• prajna-lang / prajna
  a program language for AI infrastructure
  ☆87Updated this week