openvinotoolkit / openvino_tokenizers
OpenVINO Tokenizers extension
☆30Updated this week
Alternatives and similar repositories for openvino_tokenizers:
Users that are interested in openvino_tokenizers are comparing it to the libraries listed below
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆224Updated this week
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆444Updated this week
- ONNX Runtime: cross-platform, high performance scoring engine for ML models☆59Updated this week
- Large Language Model Text Generation Inference on Habana Gaudi☆33Updated this week
- Repository for OpenVINO's extra modules☆115Updated 3 weeks ago
- OpenVINO NPU Plugin☆47Updated last month
- oneAPI Deep Neural Network Library (oneDNN)☆19Updated this week
- This repository contains Dockerfiles, scripts, yaml files, Helm charts, etc. used to scale out AI containers with versions of TensorFlow …☆35Updated last week
- A curated list of OpenVINO based AI projects☆122Updated 2 months ago
- Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…☆61Updated 2 months ago
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆173Updated this week
- LLM SDK for OnnxRuntime GenAI (OGA)☆90Updated this week
- AMD's graph optimization engine.☆210Updated this week
- The Triton backend for the ONNX Runtime.☆139Updated this week
- The framework to generate a Dockerfile, build, test, and deploy a docker image with OpenVINO™ toolkit.☆65Updated 3 weeks ago
- onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime☆361Updated this week
- With OpenVINO Test Drive, users can run large language models (LLMs) and models trained by Intel Geti on their devices, including AI PCs …☆19Updated this week
- OpenVINO backend for Triton.☆31Updated this week
- Computation using data flow graphs for scalable machine learning☆67Updated this week
- ☆34Updated this week
- Common utilities for ONNX converters☆259Updated 3 months ago
- OpenAI Triton backend for Intel® GPUs☆165Updated this week
- OpenVINO LLM Benchmark☆11Updated last year
- Software Development Kit (SDK) for the Intel® Geti™ platform for Computer Vision AI model training.☆77Updated this week
- hipBLASLt is a library that provides general matrix-matrix operations with a flexible API and extends functionalities beyond a traditiona…☆79Updated this week
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆12Updated this week
- ☆105Updated 3 months ago
- Use safetensors with ONNX 🤗☆37Updated this week
- Developer kits reference setup scripts for various kinds of Intel platforms and GPUs☆18Updated this week
- cudnn_frontend provides a c++ wrapper for the cudnn backend API and samples on how to use it☆508Updated last month