Alternatives and similar repositories for ChatBotApp:

Users that are interested in ChatBotApp are comparing it to the libraries listed below

• xxxxyu / FlexNN
  Code for ACM MobiCom 2024 paper "FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices"
  ☆53Updated 3 months ago
• ARM-software / kleidiai
  This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai
  ☆33Updated this week
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆62Updated last week
• daquexian / faster-rwkv
  ☆124Updated last year
• lrw04 / llama2.c-to-ncnn
  A converter for llama2.c legacy models to ncnn models.
  ☆87Updated last year
• CodeLinaro / llama.cpp
  LLM inference in C/C++
  ☆17Updated 2 weeks ago
• lovemefan / ggml-learning-notes
  ggml学习笔记，ggml是一个机器学习的推理框架
  ☆15Updated last year
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆108Updated 7 months ago
• InfiniTensor / RefactorGraph
  分层解耦的深度学习推理引擎
  ☆72Updated 2 months ago
• prajna-lang / prajna
  a program language for AI infrastructure
  ☆87Updated this week
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆101Updated last month
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆50Updated 5 months ago
• caijixueIT / CUDA_Learning_for_Freshman
  ☆11Updated last month
• mlc-ai / relax
  ☆156Updated 3 weeks ago
• JackonYang / hands-on-tvm
  hands on model tuning with TVM and profile it on a Mac M1, x86 CPU, and GTX-1080 GPU.
  ☆47Updated last year
• mit-han-lab / tinychat-tutorial
  ☆63Updated 5 months ago
• FlagOpen / FlagCX
  ☆49Updated this week
• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆18Updated this week
• hisrg / SNPE
  Snapdragon Neural Processing Engine (SNPE) SDKThe Snapdragon Neural Processing Engine (SNPE) is a Qualcomm Snapdragon software accelerate…
  ☆34Updated 3 years ago
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆36Updated 6 months ago
• xlite-dev / hgemm-tensorcores-mma
  ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
  ☆73Updated 3 weeks ago
• Yulv-git / Model-Inference-Deployment
  A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlo…
  ☆59Updated 11 months ago
• ling0322 / libllm
  Efficient inference of large language models.
  ☆146Updated 4 months ago
• corleonechensiyu / tinyCNN
  将MNN拆解的简易前向推理框架(for study!)
  ☆22Updated 4 years ago
• BBuf / tensorrt-llm-moe
  ☆28Updated 2 months ago
• quic / ai-engine-direct-helper
  ☆34Updated 2 weeks ago
• li199603 / sgemm_with_cuda
  SGEMM optimization with cuda step by step
  ☆18Updated last year
• pigirons / conv3x3_m1
  This is a demo how to write a high performance convolution run on apple silicon
  ☆54Updated 3 years ago
• daquexian / web-model-converter
  ☆40Updated 2 years ago
• adamydwang / mobilellama
  a lightweight C++ LLaMA inference engine for mobile devices
  ☆13Updated last year