lx200916 / ChatBotAppLinks
☆39Updated 6 months ago
Alternatives and similar repositories for ChatBotApp
Users that are interested in ChatBotApp are comparing it to the libraries listed below
Sorting:
- the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml…☆34Updated 3 months ago
- Code for ACM MobiCom 2024 paper "FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices"☆56Updated 8 months ago
- High-speed and easy-use LLM serving framework for local deployment☆124Updated 2 months ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆85Updated this week
- Fast Multimodal LLM on Mobile Devices☆1,105Updated last week
- This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai☆88Updated last week
- QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …☆77Updated last week
- LLM inference in C/C++☆46Updated this week
- mperf是一个面向移动/嵌入式平台的算子性能调优工具箱☆189Updated 2 years ago
- Awesome Mobile LLMs☆253Updated 2 weeks ago
- Penn CIS 5650 (GPU Programming and Architecture) Final Project☆42Updated last year
- ☆87Updated last week
- ☆13Updated 7 months ago
- ☆166Updated last week
- 分层解耦的深度学习推理引擎☆76Updated 8 months ago
- [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models☆68Updated last year
- The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…☆316Updated this week
- 🎉My Collections of CUDA Kernels~☆11Updated last year
- llm theoretical performance analysis tools and support params, flops, memory and latency analysis.☆108Updated 3 months ago
- ☆33Updated last year
- 使用 CUDA C++ 实现的 llama 模型推理框架☆62Updated 11 months ago
- hands on model tuning with TVM and profile it on a Mac M1, x86 CPU, and GTX-1080 GPU.☆50Updated 2 years ago
- Run generative AI models in sophgo BM1684X/BM1688☆249Updated this week
- Triton Documentation in Chinese Simplified / Triton 中文文档☆86Updated 6 months ago
- A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlo…☆68Updated last year
- Triton adapter for Ascend. Mirror of https://gitee.com/ascend/triton-ascend☆76Updated 3 weeks ago
- Repo for SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting (ISCA25)☆64Updated 5 months ago
- llm deploy project based onnx.☆45Updated last year
- LLM inference in C/C++☆18Updated last week
- To better understand the ggml library☆19Updated 4 months ago