intel / intel-npu-acceleration-library

Related projects ⓘ

Alternatives and complementary repositories for intel-npu-acceleration-library

• amd / RyzenAI-SW
  ☆399Updated this week
• openvinotoolkit / openvino.genai
  Run Generative AI models with simple C++/Python API and using OpenVINO Runtime
  ☆152Updated this week
• huggingface / optimum-intel
  🤗 Optimum Intel: Accelerate inference with Intel optimization tools
  ☆409Updated this week
• oneapi-src / SYCLomatic
  ☆231Updated this week
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆143Updated this week
• intel / intel-extension-for-tensorflow
  Intel® Extension for TensorFlow*
  ☆318Updated last month
• openvinotoolkit / npu_plugin
  OpenVINO NPU Plugin
  ☆37Updated 2 weeks ago
• microsoft / onnxscript
  ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.
  ☆286Updated this week
• intel / linux-npu-driver
  Intel® NPU (Neural Processing Unit) Driver
  ☆181Updated this week
• microsoft / onnxruntime-genai
  Generative AI extensions for onnxruntime
  ☆514Updated this week
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆348Updated 2 months ago
• ROCm / composable_kernel
  Composable Kernel: Performance Portable Programming Model for Machine Learning Tensor Operators
  ☆313Updated this week
• NVIDIA / cudnn-frontend
  cudnn_frontend provides a c++ wrapper for the cudnn backend API and samples on how to use it
  ☆455Updated 3 weeks ago
• intel / intel-extension-for-pytorch
  A Python package for extending the official PyTorch that can easily obtain performance on Intel platform
  ☆1,624Updated this week
• microsoft / T-MAC
  Low-bit LLM inference on CPU with lookup table
  ☆583Updated this week
• microsoft / BitBLAS
  BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
  ☆420Updated this week
• google-ai-edge / ai-edge-torch
  Supporting PyTorch models with the Google AI Edge TFLite runtime.
  ☆371Updated this week
• NVIDIA / TensorRT-Model-Optimizer
  TensorRT Model Optimizer is a unified library of state-of-the-art model optimization techniques such as quantization, pruning, distillati…
  ☆567Updated this week
• openvinotoolkit / openvino_tokenizers
  OpenVINO Tokenizers extension
  ☆25Updated this week
• microsoft / onnxconverter-common
  Common utilities for ONNX converters
  ☆251Updated 5 months ago
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆57Updated 2 months ago
• oneapi-community / awesome-oneapi
  An Awesome list of oneAPI projects
  ☆126Updated 3 months ago
• tenstorrent / tt-buda
  Tenstorrent TT-BUDA Repository
  ☆225Updated last month
• onnx / onnx-mlir
  Representation and Reference Lowering of ONNX Models in MLIR Compiler Infrastructure
  ☆767Updated this week
• flashinfer-ai / flashinfer
  FlashInfer: Kernel Library for LLM Serving
  ☆1,452Updated this week
• ROCm / rocm-examples
  A collection of examples for the ROCm software stack
  ☆167Updated this week
• ROCm / HIPIFY
  HIPIFY: Convert CUDA to Portable C++ Code
  ☆523Updated this week
• artyom-beilis / pytorch_dlprim
  DLPrimitives/OpenCL out of tree backend for pytorch
  ☆287Updated 2 months ago
• NVIDIA / Fuser
  A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")
  ☆270Updated this week
• microsoft / Llama-2-Onnx
  ☆1,022Updated 10 months ago