Explore LLM model deployment based on AXera's AI chips
☆149Apr 15, 2026Updated this week
Alternatives and similar repositories for ax-llm
Users that are interested in ax-llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Samples code for world class Artificial Intelligence SoCs for computer vision applications.☆287Apr 9, 2026Updated last week
- The docs repository of Pulsar2 which is AXera's SoC 2rd AI toolchain. Such as AX650A, AX650N☆17Mar 31, 2026Updated 2 weeks ago
- ☆27Jun 30, 2025Updated 9 months ago
- Demo for Qwen2.5-VL-3B-Instruct on Axera device.☆15Sep 3, 2025Updated 7 months ago
- Converts CLIP models to ONNX☆11Jan 17, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Python scripts performing Open Vocabulary Object Detection using the YOLO-World model in ONNX. And Export the ONNX model for AXera's NPU☆12Aug 11, 2025Updated 8 months ago
- the python api for axengine runtime☆26Mar 24, 2026Updated 3 weeks ago
- linux bsp app & sample for axpi (ax620a)☆36Jun 21, 2023Updated 2 years ago
- ☆23Jan 3, 2024Updated 2 years ago
- OpenAI Whisper demo on Axera☆15Jan 15, 2026Updated 3 months ago
- Linux BSP APP & Samples for AXera Pi Zero(AX620Q)☆21Nov 1, 2024Updated last year
- M5Stack dropdown menu code sample☆15Feb 5, 2019Updated 7 years ago
- ☆68Apr 10, 2026Updated last week
- Try to export the ONNX QDQ model that conforms to the AXERA NPU quantization specification. Currently, only w8a8 is supported.☆11Sep 10, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆16Aug 15, 2024Updated last year
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆20Aug 3, 2025Updated 8 months ago
- A SDK to using the Realtime API with Microcontrollers like the ESP32☆23Dec 24, 2024Updated last year
- MegEngine到其他框架的转换器☆69Apr 27, 2023Updated 2 years ago
- ☆125Dec 15, 2023Updated 2 years ago
- Whisper in TensorRT-LLM☆17Sep 21, 2023Updated 2 years ago
- c++实现的clip推理，模型有一点点改动，但是不大，改动和导出模型的代码可以在readme里找到，模型文件都在Releases里，包括AX650的模型。新增支持ChineseCLIP☆31Jun 19, 2025Updated 10 months ago
- ArduPlane, ArduCopter, ArduRover source☆10Updated this week
- ☆16Nov 6, 2025Updated 5 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- stable diffusion using mnn☆67Sep 28, 2023Updated 2 years ago
- Axera download protocol (AXDL) implementation in Rust (Unofficial)☆18Apr 4, 2025Updated last year
- 3D rendering by M5Stack☆26Apr 8, 2019Updated 7 years ago
- llm-export can export llm model to onnx.☆348Oct 24, 2025Updated 5 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆17Jun 3, 2024Updated last year
- The Pipeline example based on AX650N/AX8850 shows the software development skills of Image Processing, NPU, Codec, and Display modules, …☆14Apr 1, 2026Updated 2 weeks ago
- Handy tools & graphics API abstraction for blazing fast prototyping☆10Jan 17, 2024Updated 2 years ago
- ☆1,390Mar 12, 2026Updated last month
- Benchmark tests supporting the TiledCUDA library.☆18Nov 19, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆28Jun 27, 2023Updated 2 years ago
- linux bsp app & sample for axpi pro (ax650n)☆31Nov 12, 2024Updated last year
- Arduino library for M5Stack LLM Module☆33Oct 29, 2025Updated 5 months ago
- MegCC是一个运行时超轻量，高效，移植简单的深度学习模型编译器☆483Oct 23, 2024Updated last year
- ncnn和pnnx格式编辑器☆146Updated this week
- a single-header math library☆17Nov 7, 2025Updated 5 months ago
- ☆23Jul 31, 2025Updated 8 months ago