intel / ai-containersLinks
This repository contains Dockerfiles, scripts, yaml files, Helm charts, etc. used to scale out AI containers with versions of TensorFlow and PyTorch that have been optimized for Intel platforms. Scaling is done with python, Docker, kubernetes, kubeflow, cnvrg.io, Helm, and other container orchestration frameworks for use in the cloud and on-prem…
☆60Updated 2 weeks ago
Alternatives and similar repositories for ai-containers
Users that are interested in ai-containers are comparing it to the libraries listed below
Sorting:
- Explore our open source AI portfolio! Develop, train, and deploy your AI solutions with performance- and productivity-optimized tools fro…☆67Updated 10 months ago
- OpenVINO Tokenizers extension☆48Updated this week
- A curated list of OpenVINO based AI projects☆181Updated 7 months ago
- ☆91Updated this week
- Setup and Installation Instructions for Habana binaries, docker image creation☆28Updated last month
- AMD related optimizations for transformer models☆97Updated 3 months ago
- Large Language Model Text Generation Inference on Habana Gaudi☆34Updated 10 months ago
- No-code CLI designed for accelerating ONNX workflows☆227Updated 7 months ago
- Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…☆64Updated 7 months ago
- oneAPI Specification source files☆211Updated 3 weeks ago
- Tutorials for running models on First-gen Gaudi and Gaudi2 for Training and Inference. The source files for the tutorials on https://dev…☆64Updated 4 months ago
- ☆152Updated last month
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆532Updated this week
- Intel® AI Super Builder☆156Updated 2 weeks ago
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆428Updated this week
- ☆280Updated this week
- This repo hosts code for vLLM CI & Performance Benchmark infrastructure.☆29Updated this week
- Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench☆202Updated 9 months ago
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆205Updated last week
- This repo contains documents of the OPEA project☆43Updated last month
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆131Updated 4 months ago
- A validation and profiling tool for AI infrastructure☆360Updated this week
- MLPerf Client is a benchmark for Windows, Linux and macOS, focusing on client form factors in ML inference scenarios.☆73Updated 2 months ago
- Intel® Extension for TensorFlow*☆349Updated 3 months ago
- Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety…☆39Updated last month
- ☆137Updated last week
- Intel® SHMEM - Device initiated shared memory based communication library☆32Updated 2 months ago
- Intel® AI for Enterprise Inference optimizes AI inference services on Intel hardware using Kubernetes Orchestration. It automates LLM mod…☆32Updated this week
- An innovative library for efficient LLM inference via low-bit quantization☆352Updated last year
- ☆281Updated this week