lx200916 / ChatBotAppLinks
☆38Updated 5 months ago
Alternatives and similar repositories for ChatBotApp
Users that are interested in ChatBotApp are comparing it to the libraries listed below
Sorting:
- Code for ACM MobiCom 2024 paper "FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices"☆53Updated 8 months ago
- the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml…☆31Updated 2 months ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆83Updated last week
- High-speed and easy-use LLM serving framework for local deployment☆119Updated last month
- This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai☆81Updated last week
- QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …☆72Updated last week
- mperf是一个面向移动/嵌入式平台的算子性能调优工具箱☆188Updated 2 years ago
- LLM inference in C/C++☆45Updated last week
- Fast Multimodal LLM on Mobile Devices☆1,060Updated this week
- LLM inference in C/C++☆19Updated this week
- Awesome Mobile LLMs☆246Updated last week
- 分层解耦的深度学习推理引擎☆75Updated 7 months ago
- [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models☆67Updated last year
- ☆166Updated this week
- ☆83Updated last month
- This is a list of awesome edgeAI inference related papers.☆98Updated last year
- hands on model tuning with TVM and profile it on a Mac M1, x86 CPU, and GTX-1080 GPU.☆50Updated 2 years ago
- The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…☆301Updated this week
- 机器学习编译 陈天奇☆45Updated 2 years ago
- This is a demo how to write a high performance convolution run on apple silicon☆54Updated 3 years ago
- The open-source project for "Mandheling: Mixed-Precision On-Device DNN Training with DSP Offloading"[MobiCom'2022]☆19Updated 3 years ago
- Penn CIS 5650 (GPU Programming and Architecture) Final Project☆40Updated last year
- Triton adapter for Ascend. Mirror of https://gitee.com/ascend/triton-ascend☆74Updated this week
- Efficient inference of large language models.☆151Updated last week
- llm theoretical performance analysis tools and support params, flops, memory and latency analysis.☆107Updated 2 months ago
- llm deploy project based onnx.☆44Updated 11 months ago
- ☆98Updated 4 years ago
- ☆32Updated last year
- 🎉My Collections of CUDA Kernels~☆11Updated last year
- 模型加速/模型压缩（已完成所有Lab）☆11Updated last year