Alternatives and similar repositories for Toucan-LLM:

Users that are interested in Toucan-LLM are comparing it to the libraries listed below

• nihui / ncnn_on_esp32
  ☆76Updated last year
• nihui / riscv-v-toolchain
  prebuild package for cross compiling riscv
  ☆18Updated 3 years ago
• scarsty / ncnn-editor
  ncnn和pnnx格式编辑器
  ☆133Updated 7 months ago
• Arm-China / Model_zoo
  Zhouyi model zoo
  ☆98Updated 7 months ago
• OAID / TengineInferPipe
  ☆24Updated 2 years ago
• OAID / Tengine-Convert-Tools
  Tengine Convert Tool supports converting multi framworks' models into tmfile that suitable for Tengine-Lite AI framework.
  ☆93Updated 3 years ago
• corleonechensiyu / tinyCNN
  将MNN拆解的简易前向推理框架(for study!)
  ☆22Updated 4 years ago
• nihui / ncnn_on_xr806
  ☆15Updated 3 years ago
• lrw04 / tinyllamas-ncnn
  Inference TinyLlama models on ncnn
  ☆24Updated last year
• XUANTIE-RV / csi-nn2
  An optimized neural network operator library for chips base on Xuantie CPU.
  ☆89Updated 10 months ago
• airockchip / rknpu_ddk
  DDK for Rockchip NPU
  ☆61Updated 4 years ago
• lrw04 / llama2.c-to-ncnn
  A converter for llama2.c legacy models to ncnn models.
  ☆87Updated last year
• sipeed / axpi_bsp_sdk
  linux bsp app & sample for axpi (ax620a)
  ☆34Updated last year
• kendryte / k510_docs
  Kendryte K510 Documents
  ☆41Updated 2 years ago
• AXERA-TECH / ax650n_bsp_sdk
  linux bsp app & sample for axpi pro (ax650n)
  ☆25Updated 5 months ago
• daquexian / web-model-converter
  ☆40Updated 2 years ago
• AXERA-TECH / ax-llm
  Explore LLM model deployment based on AXera's AI chips
  ☆101Updated 2 weeks ago
• mtx512 / v831-npu
  Reverse engineering the V831 npu
  ☆93Updated 3 years ago
• hisrg / SNPE
  Snapdragon Neural Processing Engine (SNPE) SDKThe Snapdragon Neural Processing Engine (SNPE) is a Qualcomm Snapdragon software accelerate…
  ☆34Updated 3 years ago
• xmos / lib_tflite_micro
  ☆11Updated last week
• atanmarko / ncnn-with-cuda
  Tencent NCNN with added CUDA support
  ☆69Updated 4 years ago
• jinmingyi1998 / opencl_kernels
  An easy way to run, test, benchmark and tune OpenCL kernel files
  ☆23Updated last year
• xmos / ai_tools
  AI applications and tools
  ☆27Updated last week
• kendryte / k510_buildroot
  Kendryte K510 SDK
  ☆121Updated last year
• DayBreak-u / seq2seq_ncnn
  the C++ version of Seq2Seq with ncnn
  ☆23Updated 3 years ago
• sophgo / tpu_compiler
  cvitek ai compiler base on MLIR
  ☆21Updated 3 years ago
• GIBEREZ / Qt-NCNN-ByteTrack
  使用NCNN推理框架和ByteTrack目标跟踪框架，对网络、文件流URL进行实时性视频推理，而UI界面则由Qt框架实现
  ☆21Updated 6 months ago
• alohali / benchmark-models
  benchmark models for TNN, ncnn, MNN
  ☆20Updated 4 years ago
• MarsTechHAN / keras2ncnn
  A keras h5df to ncnn model converter
  ☆89Updated 2 years ago
• ChenShisen / ncnnqat
  quantize aware training package for NCNN on pytorch
  ☆70Updated 3 years ago