Alternatives and similar repositories for ChatBotApp

Users that are interested in ChatBotApp are comparing it to the libraries listed below

• zhouwg / ggml-hexagon
  an open-source reference implementation of ggml-hexagon backend for llama.cpp on Android phone equipped with Qualcomm's Hexagon NPU, det…
  ☆22Updated this week
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆68Updated last week
• ARM-software / kleidiai
  This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai
  ☆43Updated last week
• xxxxyu / FlexNN
  Code for ACM MobiCom 2024 paper "FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices"
  ☆53Updated 4 months ago
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆108Updated 2 months ago
• daquexian / faster-rwkv
  ☆123Updated last year
• chraac / llama.cpp
  LLM inference in C/C++
  ☆41Updated last week
• saic-fi / MobileQuant
  [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models
  ☆63Updated 8 months ago
• sunkx109 / GPUs-Specs
  Summary of the Specs of Commonly Used GPUs for Training and Inference of LLM
  ☆42Updated 2 months ago
• quic / ai-engine-direct-helper
  QAI AppBuilder is designed for developer to using Qualcomm® AI Runtime SDK to execute model on Windows on Snapdragon(WoS) and Linux platf…
  ☆41Updated this week
• mlc-ai / relax
  ☆157Updated this week
• hisrg / SNPE
  Snapdragon Neural Processing Engine (SNPE) SDKThe Snapdragon Neural Processing Engine (SNPE) is a Qualcomm Snapdragon software accelerate…
  ☆35Updated 3 years ago
• MegEngine / mperf
  mperf是一个面向移动/嵌入式平台的算子性能调优工具箱
  ☆187Updated last year
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆37Updated 7 months ago
• lrw04 / llama2.c-to-ncnn
  A converter for llama2.c legacy models to ncnn models.
  ☆87Updated last year
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆109Updated 8 months ago
• xlite-dev / HGEMM
  ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
  ☆79Updated 3 weeks ago
• sihyeong / Awesome-LLM-Inference-Engine
  ☆66Updated 3 weeks ago
• InfiniTensor / RefactorGraph
  分层解耦的深度学习推理引擎
  ☆73Updated 3 months ago
• infinigence / SpecEE
  Repo for SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting (ISCA25)
  ☆36Updated last month
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆100Updated last year
• Kyrie-Zhao / awesome-real-time-AI
  This is a list of awesome edgeAI inference related papers.
  ☆96Updated last year
• YangLinzhuo / cuda-sgemm-optimization
  CUDA SGEMM optimization note
  ☆13Updated last year
• pigirons / conv3x3_m1
  This is a demo how to write a high performance convolution run on apple silicon
  ☆54Updated 3 years ago
• UbiquitousLearning / Mandheling-DSP-Training
  The open-source project for "Mandheling: Mixed-Precision On-Device DNN Training with DSP Offloading"[MobiCom'2022]
  ☆19Updated 2 years ago
• DakeQQ / Native-LLM-for-Android
  Demonstration of running a native LLM on Android device.
  ☆142Updated last week
• CodeLinaro / llama.cpp
  LLM inference in C/C++
  ☆17Updated this week
• tlc-pack / cutlass_fpA_intB_gemm
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆92Updated last week
• mlsys-io / kv.run
  A model serving framework for various research and production scenarios. Seamlessly built upon the PyTorch and HuggingFace ecosystem.
  ☆23Updated 7 months ago
• OAID / TengineInferPipe
  ☆24Updated 2 years ago