Alternatives and similar repositories for ChatBotApp:

Users that are interested in ChatBotApp are comparing it to the libraries listed below

• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and (WIP) v7 with Qualcomm AI Engine Direct SDK
  ☆49Updated last week
• DataXujing / Qwen1.5-0.5b-chat-android
  基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat
  ☆63Updated 9 months ago
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆30Updated 3 months ago
• xxxxyu / FlexNN
  Code for ACM MobiCom 2024 paper "FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices"
  ☆47Updated last week
• daquexian / faster-rwkv
  ☆124Updated last year
• TroyTzou / mlc-llm-android
  参考自mlc-llm，个人尝试在android手机上部署大模型并运行
  ☆71Updated 5 months ago
• lrw04 / llama2.c-to-ncnn
  A converter for llama2.c legacy models to ncnn models.
  ☆86Updated last year
• wangzhaode / mnn-stable-diffusion
  stable diffusion using mnn
  ☆65Updated last year
• daquexian / web-model-converter
  ☆38Updated 2 years ago
• DakeQQ / Native-LLM-for-Android
  Demonstration of running a native LLM on Android device.
  ☆106Updated this week
• OAID / TengineInferPipe
  ☆24Updated 2 years ago
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆78Updated 3 weeks ago
• tpoisonooo / llama.onnx
  LLaMa/RWKV onnx models, quantization and testcase
  ☆356Updated last year
• lovemefan / ggml-learning-notes
  ggml学习笔记，ggml是一个机器学习的推理框架
  ☆14Updated 10 months ago
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆41Updated last year
• sophgo / LLM-TPU
  Run generative AI models in sophgo BM1684X
  ☆155Updated this week
• hisrg / SNPE
  Snapdragon Neural Processing Engine (SNPE) SDKThe Snapdragon Neural Processing Engine (SNPE) is a Qualcomm Snapdragon software accelerate…
  ☆33Updated 2 years ago
• inisis / OnnxSlim
  A Toolkit to Help Optimize Onnx Model
  ☆106Updated this week
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆99Updated 4 months ago
• keith2018 / TinyGPT
  Tiny C++11 GPT-2 inference implementation from scratch
  ☆53Updated last month
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆44Updated 2 months ago
• guoguo1314 / llama3_learn.c
  Inference deployment of the llama3
  ☆11Updated 9 months ago
• AXERA-TECH / ax-llm
  Explore LLM model deployment based on AXera's AI chips
  ☆71Updated last month
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆45Updated last year
• EdVince / DragGan-NCNN
  DragGan in NCNN with c++
  ☆49Updated last year
• OpenPPL / ppl.common
  Common libraries for PPL projects
  ☆29Updated 3 months ago
• inisis / OnnxLLM
  Large Language Model Onnx Inference Framework
  ☆28Updated 2 weeks ago
• ling0322 / libllm
  Efficient inference of large language models.
  ☆145Updated last month
• wangzhaode / llm-export
  llm-export can export llm model to onnx.
  ☆257Updated last week
• XiaoMi / StableDiffusionOnDevice
  本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。
  ☆135Updated 10 months ago