intel / ai-containersLinks
This repository contains Dockerfiles, scripts, yaml files, Helm charts, etc. used to scale out AI containers with versions of TensorFlow and PyTorch that have been optimized for Intel platforms. Scaling is done with python, Docker, kubernetes, kubeflow, cnvrg.io, Helm, and other container orchestration frameworks for use in the cloud and on-prem…
☆45Updated this week
Alternatives and similar repositories for ai-containers
Users that are interested in ai-containers are comparing it to the libraries listed below
Sorting:
- Explore our open source AI portfolio! Develop, train, and deploy your AI solutions with performance- and productivity-optimized tools fro…☆40Updated 2 months ago
- OpenVINO Tokenizers extension☆34Updated this week
- Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…☆61Updated 3 months ago
- Large Language Model Text Generation Inference on Habana Gaudi☆33Updated 2 months ago
- AMD related optimizations for transformer models☆77Updated 7 months ago
- ☆46Updated this week
- A repository of Dockerfiles, scripts, yaml files, Helm Charts, etc. used to build and scale the sample AI workflows with python, kubernet…☆11Updated last year
- Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety…☆35Updated 2 weeks ago
- Source Code and Usage Samples for the Resources hosted in the NVIDIA AI Enterprise AzureML Registry☆20Updated 9 months ago
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆127Updated last month
- oneAPI Specification source files☆201Updated last week
- Machine Learning Agility (MLAgility) benchmark and benchmarking tools☆39Updated 3 weeks ago
- Use safetensors with ONNX 🤗☆61Updated 3 months ago
- GenAI Studio is a low code platform to enable users to construct, evaluate, and benchmark GenAI applications. The platform also provide c…☆43Updated 3 weeks ago
- ☆20Updated this week
- SynapseAI Core is a reference implementation of the SynapseAI API running on Habana Gaudi☆41Updated 4 months ago
- An Awesome list of oneAPI projects☆144Updated 5 months ago
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆282Updated this week
- Libraries and tools to support Transfer Learning☆19Updated last month
- No-code CLI designed for accelerating ONNX workflows☆192Updated 2 weeks ago
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆86Updated last week
- A GPU-driven system framework for scalable AI applications☆114Updated 4 months ago
- Estimating hardware and cloud costs of LLMs and transformer projects☆16Updated last year
- OpenAI Triton backend for Intel® GPUs☆187Updated this week
- Intel® SHMEM - Device initiated shared memory based communication library☆23Updated 2 months ago
- Repository of model demos using TT-Buda☆62Updated 2 months ago
- Rats is a collection of tools to help researchers define and run experiments. It is designed to be a modular and extensible framework cur…☆23Updated this week
- Self-host LLMs with LMDeploy and BentoML☆19Updated 2 months ago
- The Intel® In-Band Manageability Framework enables an administrator to perform critical Device Management operations over-the-air remotel…☆31Updated last week
- ☆33Updated last week