pomoke / torch-apu-helper
Make PyTorch models at least run on APUs.
☆52Updated last year
Alternatives and similar repositories for torch-apu-helper:
Users that are interested in torch-apu-helper are comparing it to the libraries listed below
- ☆51Updated last year
- ☆398Updated this week
- Reverse engineering the rk3588 npu☆75Updated 9 months ago
- ☆274Updated this week
- Because RKNPU only knows 4D☆32Updated last year
- ☆40Updated last year
- ☆54Updated 9 months ago
- ☆37Updated last year
- Running SXM2/SXM3/SXM4 NVidia data center GPUs in consumer PCs☆98Updated last year
- ☆491Updated 3 weeks ago
- ☆57Updated 2 years ago
- GPU Power and Performance Manager☆57Updated 5 months ago
- My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend☆88Updated this week
- 8-bit CUDA functions for PyTorch Rocm compatible☆39Updated last year
- Onboarding documentation source for the AMD Ryzen™ AI Software Platform. The AMD Ryzen™ AI Software Platform enables developers to take…☆52Updated this week
- build scripts for ROCm☆188Updated last year
- Customized ACPI method for overriding mobile AMD APU STAPM values☆36Updated 6 years ago
- Linux based GDDR6/GDDR6X VRAM temperature reader for NVIDIA RTX 3000/4000 series GPUs.☆96Updated 7 months ago
- 8-bit CUDA functions for PyTorch, ported to HIP for use in AMD GPUs☆49Updated last year
- ☆227Updated 2 years ago
- Deep Learning Primitives and Mini-Framework for OpenCL☆190Updated 6 months ago
- LLM inference in C/C++☆13Updated 2 weeks ago
- 4 bits quantization of LLaMA using GPTQ, ported to HIP for use in AMD GPUs.☆32Updated last year
- Lightweight Inference server for OpenVINO☆142Updated this week
- DLPrimitives/OpenCL out of tree backend for pytorch☆335Updated 6 months ago
- ☆17Updated 2 months ago
- AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1☆200Updated last month
- AMD related optimizations for transformer models☆71Updated 4 months ago
- Download models from the Ollama library, without Ollama☆66Updated 4 months ago
- NVIDIA Linux open GPU with P2P support☆13Updated this week