lx200916 / ChatBotAppLinks
☆42Updated 10 months ago
Alternatives and similar repositories for ChatBotApp
Users that are interested in ChatBotApp are comparing it to the libraries listed below
Sorting:
- the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml…☆35Updated 6 months ago
- [MobiCom 24] Efficient and Adaptive DNN inference under changeable memory budgets☆58Updated last year
- ☆116Updated this week
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆90Updated last week
- QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …☆108Updated last week
- LLM inference in C/C++☆48Updated this week
- High-speed and easy-use LLM serving framework for local deployment☆145Updated 5 months ago
- This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai☆113Updated this week
- Fast Multimodal LLM on Mobile Devices☆1,370Updated this week
- The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…☆369Updated this week
- mperf是一个面向移动/嵌入式平台的算子性能调优工具箱☆193Updated 2 years ago
- ☆171Updated last week
- Awesome Mobile LLMs☆301Updated 2 months ago
- [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models☆68Updated last year
- ☆52Updated last month
- Penn CIS 5650 (GPU Programming and Architecture) Final Project☆44Updated 2 years ago
- hands on model tuning with TVM and profile it on a Mac M1, x86 CPU, and GTX-1080 GPU.☆49Updated 2 years ago
- 分层解耦的深度学习推理引擎☆79Updated 11 months ago
- llm theoretical performance analysis tools and support params, flops, memory and latency analysis.☆114Updated 6 months ago
- Self-implemented NN operators for Qualcomm's Hexagon NPU☆45Updated 4 months ago
- The open-source project for "Mandheling: Mixed-Precision On-Device DNN Training with DSP Offloading"[MobiCom'2022]☆19Updated 3 years ago
- LLM inference in C/C++☆20Updated 3 months ago
- Repo for SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting (ISCA25)☆70Updated 9 months ago
- FlagTree is a unified compiler supporting multiple AI chip backends for custom Deep Learning operations, which is forked from triton-lang…☆197Updated this week
- Triton for OpenCL backend, and use mlir-translate to get source OpenCL code☆24Updated 5 months ago
- ☆179Updated last week
- Demonstration of running a native LLM on Android device.☆222Updated this week
- 使用 CUDA C++ 实现的 llama 模型推理框架☆64Updated last year
- This is a list of awesome edgeAI inference related papers.☆98Updated 2 years ago
- edge/mobile transformer based Vision DNN inference benchmark☆16Updated 5 months ago