Alternatives and similar repositories for ChatBotApp

Users that are interested in ChatBotApp are comparing it to the libraries listed below

• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆104Updated last month
• zhouwg / ggml-hexagon
  try to build a fully open-source ggml-hexagon backend for llama.cpp on Android phone equipped with Qualcomm's Hexagon NPU, details can b…
  ☆19Updated this week
• ARM-software / kleidiai
  This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai
  ☆37Updated this week
• xxxxyu / FlexNN
  Code for ACM MobiCom 2024 paper "FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices"
  ☆54Updated 3 months ago
• quic / ai-engine-direct-helper
  ☆36Updated this week
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆36Updated 7 months ago
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆64Updated last week
• saic-fi / MobileQuant
  [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models
  ☆56Updated 7 months ago
• tfruan2000 / mlsys-study-note
  My study note for mlsys
  ☆15Updated 6 months ago
• chraac / llama.cpp
  LLM inference in C/C++
  ☆41Updated this week
• UbiquitousLearning / mllm
  Fast Multimodal LLM on Mobile Devices
  ☆861Updated last month
• jeho-lee / Awesome-On-Device-AI-Systems
  ☆36Updated 3 weeks ago
• UbiquitousLearning / Mandheling-DSP-Training
  The open-source project for "Mandheling: Mixed-Precision On-Device DNN Training with DSP Offloading"[MobiCom'2022]
  ☆19Updated 2 years ago
• mlc-ai / relax
  ☆156Updated last month
• stevelaskaridis / awesome-mobile-llm
  Awesome Mobile LLMs
  ☆184Updated last month
• DefTruth / lite.ai.toolkit
  🛠 A lite C++ toolkit: contains 100+ Awesome AI models, support MNN, NCNN, TNN, ONNXRuntime and TensorRT. 🎉🎉
  ☆14Updated last month
• CodeLinaro / llama.cpp
  LLM inference in C/C++
  ☆16Updated 2 weeks ago
• FlagOpen / FlagCX
  ☆58Updated this week
• DataXujing / Qwen1.5-0.5b-chat-android
  基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat
  ☆77Updated last year
• OAID / TengineInferPipe
  ☆24Updated 2 years ago
• caijixueIT / CUDA_Learning_for_Freshman
  ☆11Updated 2 months ago
• yinuotxie / Efficient-LLM-Inferencing-on-GPUs
  Penn CIS 5650 (GPU Programming and Architecture) Final Project
  ☆30Updated last year
• InfiniTensor / RefactorGraph
  分层解耦的深度学习推理引擎
  ☆73Updated 3 months ago
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆73Updated last month
• daquexian / faster-rwkv
  ☆124Updated last year
• sunkx109 / GPUs-Specs
  Summary of the Specs of Commonly Used GPUs for Training and Inference of LLM
  ☆39Updated 2 months ago
• MegEngine / mperf
  mperf是一个面向移动/嵌入式平台的算子性能调优工具箱
  ☆185Updated last year
• mit-han-lab / tinychat-tutorial
  ☆65Updated 6 months ago
• EdVince / llm-cpp
  ☆32Updated 9 months ago
• Terapines / AI-Benchmark
  RISCV C and Triton AI-Benchmark
  ☆16Updated 6 months ago