Alternatives and similar repositories for ChatBotApp:

Users that are interested in ChatBotApp are comparing it to the libraries listed below

• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆60Updated this week
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆94Updated last week
• saic-fi / MobileQuant
  [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models
  ☆56Updated 6 months ago
• FlagOpen / FlagCX
  ☆45Updated this week
• DakeQQ / Native-LLM-for-Android
  Demonstration of running a native LLM on Android device.
  ☆126Updated this week
• xxxxyu / FlexNN
  Code for ACM MobiCom 2024 paper "FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices"
  ☆51Updated 2 months ago
• hisrg / SNPE
  Snapdragon Neural Processing Engine (SNPE) SDKThe Snapdragon Neural Processing Engine (SNPE) is a Qualcomm Snapdragon software accelerate…
  ☆34Updated 2 years ago
• quic / ai-engine-direct-helper
  ☆32Updated 3 weeks ago
• daquexian / faster-rwkv
  ☆124Updated last year
• lrw04 / llama2.c-to-ncnn
  A converter for llama2.c legacy models to ncnn models.
  ☆87Updated last year
• ARM-software / kleidiai
  This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai
  ☆26Updated this week
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆35Updated 5 months ago
• TroyTzou / mlc-llm-android
  参考自mlc-llm，个人尝试在android手机上部署大模型并运行
  ☆85Updated 7 months ago
• BBuf / tensorrt-llm-moe
  ☆23Updated last month
• stevelaskaridis / awesome-mobile-llm
  Awesome Mobile LLMs
  ☆156Updated last week
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆93Updated last year
• mit-han-lab / tinychat-tutorial
  ☆61Updated 4 months ago
• CodeLinaro / llama.cpp
  LLM inference in C/C++
  ☆16Updated this week
• EdVince / model_zoo
  Recording models
  ☆13Updated last year
• daquexian / web-model-converter
  ☆40Updated 2 years ago
• XiaoMi / StableDiffusionOnDevice
  本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。
  ☆147Updated last year
• AXERA-TECH / ax-llm
  Explore LLM model deployment based on AXera's AI chips
  ☆87Updated last week
• mlc-ai / relax
  ☆157Updated last week
• nihui / ncnn-android-yolov8
  ncnn android yolov8 realtime detection, segmentation, pose estimation, classification and obb
  ☆75Updated 2 months ago
• UbiquitousLearning / Mandheling-DSP-Training
  The open-source project for "Mandheling: Mixed-Precision On-Device DNN Training with DSP Offloading"[MobiCom'2022]
  ☆18Updated 2 years ago
• UbiquitousLearning / mllm
  Fast Multimodal LLM on Mobile Devices
  ☆781Updated last week
• chraac / llama.cpp
  LLM inference in C/C++
  ☆34Updated last week
• ling0322 / libllm
  Efficient inference of large language models.
  ☆146Updated 3 months ago
• MegEngine / mperf
  mperf是一个面向移动/嵌入式平台的算子性能调优工具箱
  ☆179Updated last year
• HandH1998 / QQQ
  QQQ is an innovative and hardware-optimized W4A8 quantization solution for LLMs.
  ☆109Updated 2 weeks ago