Explore LLM model deployment based on AXera's AI chips, It provides OpenAI‑compatible APIs and supports AX620E, AX650 and AX637 series chips.
☆170Nov 3, 2026Updated this week
Alternatives and similar repositories for ax-llm
Users that are interested in ax-llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Samples code for world class Artificial Intelligence SoCs for computer vision applications.☆304Oct 13, 2026Updated 3 weeks ago
- the python api for axengine runtime☆29Mar 24, 2026Updated 7 months ago
- The docs repository of Pulsar2 which is AXera's SoC 2rd AI toolchain. Such as AX8860, AX8850, AX8910, AX630C, AX620Q, AX615☆21Updated this week
- ☆29Jun 30, 2025Updated last year
- OpenAI Whisper demo on Axera☆17Jan 15, 2026Updated 9 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Demo for Qwen2.5-VL-3B-Instruct on Axera device.☆16Sep 3, 2025Updated last year
- Python scripts performing Open Vocabulary Object Detection using the YOLO-World model in ONNX. And Export the ONNX model for AXera's NPU☆12Aug 11, 2025Updated last year
- ☆74Oct 29, 2026Updated last week
- linux bsp app & sample for axpi pro (ax650n)☆33Nov 12, 2024Updated last year
- Converts CLIP models to ONNX☆11Jan 17, 2023Updated 3 years ago
- Try to export the ONNX QDQ model that conforms to the AXERA NPU quantization specification. Currently, only w8a8 is supported.☆11Sep 10, 2024Updated 2 years ago
- linux bsp app & sample for axpi (ax620a)☆36Jun 21, 2023Updated 3 years ago
- ☆18Dec 7, 2023Updated 2 years ago
- ☆23Jan 3, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Linux BSP APP & Samples for AXera Pi Zero(AX620Q)☆26Nov 1, 2024Updated 2 years ago
- About Samples code for Axera's PCIE Card for computer vision applications.☆21Oct 9, 2026Updated 3 weeks ago
- This project is built upon the official Ultralytics repository, delivering QAT quantization solutions for various Axera chip platforms. I…☆13Oct 30, 2026Updated last week
- The Pipeline example based on AX650N/AX8850 shows the software development skills of Image Processing, NPU, Codec, and Display modules, …☆25Oct 12, 2026Updated 3 weeks ago
- MeloTTS demo on Axera☆14Jul 1, 2026Updated 4 months ago
- c++实现的clip推理，模型有一点点改动，但是不大，改动和导出模型的代码可以在readme里找到，模型文件都在Releases里，包括AX650的模型。新增支持ChineseCLIP☆31Jun 19, 2025Updated last year
- ☆126Dec 15, 2023Updated 2 years ago
- SAM and lama inpaint，包含QT的GUI交互界面，实现了交互式可实时显示结果的画点、画框进行SAM，然后通过进行Inpaint，具体操作看readme里的视频。☆54Jan 30, 2024Updated 2 years ago
- ☆1,756Sep 29, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Whisper in TensorRT-LLM☆16Sep 21, 2023Updated 3 years ago
- ncnn version of CodeFormer☆109Mar 9, 2023Updated 3 years ago
- kokoro tts in cpp☆18Nov 30, 2025Updated 11 months ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆100Updated this week
- ☆11Nov 25, 2025Updated 11 months ago
- an example of segment-anything infer by ncnn☆123May 5, 2023Updated 3 years ago
- YOLOv5在高通AI Engine Direct环境下进行QNN量化，CPU推理的项目☆17Sep 10, 2024Updated 2 years ago
- stable diffusion using mnn☆68Sep 28, 2023Updated 3 years ago
- Lightweight ncnn C API bindings for MicroPython☆13Dec 7, 2025Updated 11 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- molly, an LLM designed to understand multi-omics data.☆27Dec 23, 2025Updated 10 months ago
- M5Stack dropdown menu code sample☆15Feb 5, 2019Updated 7 years ago
- llm-export can export llm model to onnx.☆357May 8, 2026Updated 5 months ago
- ncnn和pnnx格式编辑器☆148Jul 15, 2026Updated 3 months ago
- a repo to study TensorRT Plugin☆11Apr 30, 2025Updated last year
- MegEngine到其他框架的转换器☆73Apr 27, 2023Updated 3 years ago
- Instant voice cloning by MIT and MyShell. Audio foundation model.☆14Apr 9, 2025Updated last year