pomoke / torch-apu-helper
Make PyTorch models at least run on APUs.
☆41Updated 9 months ago
Related projects: ⓘ
- ☆35Updated 5 months ago
- Reverse engineering the rk3588 npu☆58Updated 3 months ago
- ☆51Updated 3 months ago
- My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend☆62Updated last week
- Run Large Language Models on RK3588 with GPU-acceleration☆80Updated last year
- 8-bit CUDA functions for PyTorch, ported to HIP for use in AMD GPUs☆43Updated last year
- Because RKNPU only knows 4D☆29Updated 6 months ago
- ☆41Updated last year
- ☆131Updated this week
- ☆291Updated this week
- Easy usage of Rockchip's NPUs found in RK3588 and similar chips☆81Updated 2 months ago
- Stable Difussion inference on Intel Arc dGPUs☆67Updated 6 months ago
- Deep Learning Primitives and Mini-Framework for OpenCL☆169Updated last week
- 8-bit CUDA functions for PyTorch Rocm compatible☆37Updated 5 months ago
- ☆346Updated 2 weeks ago
- ☆37Updated last year
- AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1☆159Updated this week
- DEPRECATED!☆53Updated 2 months ago
- ☆57Updated last year
- Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series☆53Updated last month
- ☆44Updated this week
- A set of utilities for monitoring and customizing GPU performance☆137Updated 3 months ago
- ☆193Updated last year
- Linux based GDDR6/GDDR6X VRAM temperature reader for NVIDIA RTX 3000/4000 series GPUs.☆69Updated 3 weeks ago
- LLM training in simple, raw C/HIP for AMD GPUs☆29Updated last month
- Onboarding documentation source for the AMD Ryzen™ AI Software Platform. The AMD Ryzen™ AI Software Platform enables developers to take…☆43Updated 3 weeks ago
- build scripts for ROCm☆181Updated 8 months ago
- 4 bits quantization of LLaMA using GPTQ, ported to HIP for use in AMD GPUs.☆32Updated 11 months ago
- DLPrimitives/OpenCL out of tree backend for pytorch☆272Updated 2 weeks ago
- A converter and basic tester for rwkv onnx☆40Updated 7 months ago