Alternatives and similar repositories for ChatBotApp

Users that are interested in ChatBotApp are comparing it to the libraries listed below

• xxxxyu / FlexNN
  Code for ACM MobiCom 2024 paper "FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices"
  ☆54Updated 5 months ago
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆72Updated last week
• zhouwg / ggml-hexagon
  reference implementation of the backend for llama.cpp on Android phone equipped with Qualcomm's Hexagon NPU, details can be seen at http…
  ☆23Updated this week
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆112Updated 3 months ago
• mlc-ai / relax
  ☆158Updated last week
• UbiquitousLearning / mllm
  Fast Multimodal LLM on Mobile Devices
  ☆929Updated last week
• ling0322 / libllm
  Efficient inference of large language models.
  ☆148Updated last week
• chraac / llama.cpp
  LLM inference in C/C++
  ☆42Updated last week
• ARM-software / kleidiai
  This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai
  ☆51Updated this week
• MegEngine / mperf
  mperf是一个面向移动/嵌入式平台的算子性能调优工具箱
  ☆186Updated last year
• StudyingLover / ggml-tutorial
  ☆31Updated 9 months ago
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆42Updated 8 months ago
• DakeQQ / Native-LLM-for-Android
  Demonstration of running a native LLM on Android device.
  ☆146Updated 2 weeks ago
• AXERA-TECH / ax-llm
  Explore LLM model deployment based on AXera's AI chips
  ☆107Updated last week
• hisrg / SNPE
  Snapdragon Neural Processing Engine (SNPE) SDKThe Snapdragon Neural Processing Engine (SNPE) is a Qualcomm Snapdragon software accelerate…
  ☆34Updated 3 years ago
• quic / ai-engine-direct-helper
  QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …
  ☆50Updated this week
• UbiquitousLearning / PhoneLM
  ☆57Updated 7 months ago
• InfiniTensor / RefactorGraph
  分层解耦的深度学习推理引擎
  ☆73Updated 4 months ago
• lrw04 / llama2.c-to-ncnn
  A converter for llama2.c legacy models to ncnn models.
  ☆81Updated last year
• daquexian / faster-rwkv
  ☆124Updated last year
• DataXujing / Qwen1.5-0.5b-chat-android
  基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat
  ☆79Updated last year
• keith2018 / TinyGPT
  Tiny C++11 GPT-2 inference implementation from scratch
  ☆62Updated last month
• mlsys-io / kv.run
  A model serving framework for various research and production scenarios. Seamlessly built upon the PyTorch and HuggingFace ecosystem.
  ☆23Updated 8 months ago
• CodeLinaro / llama.cpp
  LLM inference in C/C++
  ☆17Updated last week
• adamydwang / mobilellama
  a lightweight C++ LLaMA inference engine for mobile devices
  ☆13Updated last year
• Ascend / triton-ascend
  Triton adapter for Ascend. Mirror of https://gitee.com/ascend/triton-ascend
  ☆54Updated this week
• Chivier / easy-gpt4o
  Easy-GPT4O opensource version
  ☆77Updated last year
• mit-han-lab / tinychat-tutorial
  ☆69Updated 7 months ago
• TroyTzou / mlc-llm-android
  参考自mlc-llm，个人尝试在android手机上部署大模型并运行
  ☆86Updated 10 months ago
• wangzhaode / mnn-stable-diffusion
  stable diffusion using mnn
  ☆65Updated last year