Alternatives and similar repositories for ChatBotApp

Users that are interested in ChatBotApp are comparing it to the libraries listed below

• zhouwg / ggml-hexagon
  ☆25Updated this week
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆75Updated this week
• xxxxyu / FlexNN
  Code for ACM MobiCom 2024 paper "FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices"
  ☆55Updated 5 months ago
• chraac / llama.cpp
  LLM inference in C/C++
  ☆42Updated this week
• UbiquitousLearning / mllm
  Fast Multimodal LLM on Mobile Devices
  ☆948Updated last month
• ARM-software / kleidiai
  This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai
  ☆56Updated this week
• CodeLinaro / llama.cpp
  LLM inference in C/C++
  ☆18Updated last week
• MegEngine / mperf
  mperf是一个面向移动/嵌入式平台的算子性能调优工具箱
  ☆186Updated last year
• quic / ai-hub-apps
  The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…
  ☆232Updated 2 weeks ago
• InfiniTensor / RefactorGraph
  分层解耦的深度学习推理引擎
  ☆73Updated 5 months ago
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆98Updated this week
• mlc-ai / relax
  ☆161Updated last week
• JackonYang / hands-on-tvm
  hands on model tuning with TVM and profile it on a Mac M1, x86 CPU, and GTX-1080 GPU.
  ☆48Updated 2 years ago
• microsoft / T-MAC
  Low-bit LLM inference on CPU/NPU with lookup table
  ☆823Updated last month
• jeho-lee / Awesome-On-Device-AI-Systems
  ☆61Updated last month
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆112Updated 3 months ago
• quic / ai-engine-direct-helper
  QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …
  ☆55Updated this week
• doongz / mlc-ai
  机器学习编译 陈天奇
  ☆37Updated 2 years ago
• yinuotxie / Efficient-LLM-Inferencing-on-GPUs
  Penn CIS 5650 (GPU Programming and Architecture) Final Project
  ☆34Updated last year
• DakeQQ / Native-LLM-for-Android
  Demonstration of running a native LLM on Android device.
  ☆151Updated this week
• Ascend / triton-ascend
  Triton adapter for Ascend. Mirror of https://gitee.com/ascend/triton-ascend
  ☆59Updated this week
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆74Updated 3 months ago
• sophgo / LLM-TPU
  Run generative AI models in sophgo BM1684X/BM1688
  ☆225Updated this week
• xlite-dev / ffpa-attn
  ⚡️FFPA: Extend FlashAttention-2 with Split-D, achieve ~O(1) SRAM complexity for large headdim, 1.8x~3x↑ vs SDPA.🎉
  ☆192Updated 2 months ago
• mlsys-io / kv.run
  A model serving framework for various research and production scenarios. Seamlessly built upon the PyTorch and HuggingFace ecosystem.
  ☆23Updated 9 months ago
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆84Updated last month
• tlc-pack / cutlass_fpA_intB_gemm
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆93Updated this week
• saic-fi / MobileQuant
  [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models
  ☆65Updated 9 months ago
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆42Updated 9 months ago
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆58Updated 8 months ago