intel / intel-npu-acceleration-libraryLinks
Intel® NPU Acceleration Library
☆689Updated 4 months ago
Alternatives and similar repositories for intel-npu-acceleration-library
Users that are interested in intel-npu-acceleration-library are comparing it to the libraries listed below
Sorting:
- AMD Ryzen™ AI Software includes the tools and runtime libraries for optimizing and deploying AI inference on AMD Ryzen™ AI powered PCs.☆636Updated last month
- A Python package for extending the official PyTorch that can easily obtain performance on Intel platform☆1,953Updated 2 weeks ago
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆334Updated this week
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆489Updated this week
- OpenVINO Intel NPU Compiler☆66Updated last week
- Intel® NPU (Neural Processing Unit) Driver☆313Updated 2 weeks ago
- Generative AI extensions for onnxruntime☆825Updated this week
- Intel® Extension for TensorFlow*☆346Updated 5 months ago
- No-code CLI designed for accelerating ONNX workflows☆214Updated 3 months ago
- DLPrimitives/OpenCL out of tree backend for pytorch☆368Updated last year
- cudnn_frontend provides a c++ wrapper for the cudnn backend API and samples on how to use it☆612Updated last week
- Low-bit LLM inference on CPU/NPU with lookup table☆852Updated 3 months ago
- A collection of examples for the ROCm software stack☆238Updated this week
- HIPIFY: Convert CUDA to Portable C++ Code☆619Updated this week
- ☆127Updated 3 weeks ago
- ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.☆381Updated this week
- OpenAI Triton backend for Intel® GPUs☆206Updated this week
- ☆267Updated last week
- SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…☆2,491Updated this week
- Composable Kernel: Performance Portable Programming Model for Machine Learning Tensor Operators☆460Updated this week
- [DEPRECATED] Moved to ROCm/rocm-libraries repo☆111Updated this week
- An innovative library for efficient LLM inference via low-bit quantization☆348Updated last year
- Reference implementations of MLPerf™ inference benchmarks☆1,461Updated this week
- Representation and Reference Lowering of ONNX Models in MLIR Compiler Infrastructure☆911Updated this week
- An MLIR-based toolchain for AMD AI Engine-enabled devices.☆480Updated this week
- ☆123Updated last week
- AMD SMI☆86Updated this week
- BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.☆667Updated last month
- Advanced Quantization Algorithm for LLMs and VLMs, with support for CPU, Intel GPU, CUDA and HPU.☆614Updated this week
- AI Tensor Engine for ROCm☆267Updated this week