Alternatives and similar repositories for ai-containers

Users that are interested in ai-containers are comparing it to the libraries listed below

• openvinotoolkit / openvino_tokenizers
  OpenVINO Tokenizers extension
  ☆42Updated last week
• huggingface / tgi-gaudi
  Large Language Model Text Generation Inference on Habana Gaudi
  ☆34Updated 7 months ago
• intel / ai
  Explore our open source AI portfolio! Develop, train, and deploy your AI solutions with performance- and productivity-optimized tools fro…
  ☆55Updated 7 months ago
• onnx / turnkeyml
  No-code CLI designed for accelerating ONNX workflows
  ☆215Updated 4 months ago
• HabanaAI / Gaudi-tutorials
  Tutorials for running models on First-gen Gaudi and Gaudi2 for Training and Inference. The source files for the tutorials on https://dev…
  ☆61Updated last month
• NVIDIA / NVIDIA_AI_Enterprise_AzureML
  Source Code and Usage Samples for the Resources hosted in the NVIDIA AI Enterprise AzureML Registry
  ☆21Updated last year
• openvinotoolkit / awesome-openvino
  A curated list of OpenVINO based AI projects
  ☆164Updated 4 months ago
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆63Updated 4 months ago
• HabanaAI / Setup_and_Install
  Setup and Installation Instructions for Habana binaries, docker image creation
  ☆26Updated last month
• uxlfoundation / foundation
  ☆89Updated last week
• huggingface / optimum-intel
  🤗 Optimum Intel: Accelerate inference with Intel optimization tools
  ☆503Updated this week
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆199Updated this week
• openvinotoolkit / openvino.genai
  Run Generative AI models with simple C++/Python API and using OpenVINO Runtime
  ☆365Updated this week
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆349Updated last year
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆93Updated 2 weeks ago
• vllm-project / vllm-openvino
  ☆24Updated 2 months ago
• uxlfoundation / oneAPI-spec
  oneAPI Specification source files
  ☆208Updated last week
• open-edge-platform / edge-developer-kit-reference-scripts
  Developer kits reference setup scripts for various kinds of Intel platforms and GPUs
  ☆38Updated this week
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆132Updated last month
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆186Updated 6 months ago
• IntelSoftware / Machine-Learning-using-oneAPI
  Machine Learning using oneAPI. Explores Intel Extensions for scikit-learn* and NumPy, SciPy, Pandas powered by oneAPI
  ☆41Updated last year
• mlcommons / cm4mlops
  Legacy CM repository with a collection of portable, reusable and cross-platform CM automations for MLOps and MLPerf to simplify the proce…
  ☆19Updated 7 months ago
• vllm-project / ci-infra
  This repo hosts code for vLLM CI & Performance Benchmark infrastructure.
  ☆23Updated this week
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆90Updated last week
• opea-project / GenAIComps
  GenAI components at micro-service level; GenAI service composer to create mega-service
  ☆180Updated last week
• microsoft / ark
  A GPU-driven system framework for scalable AI applications
  ☆119Updated 8 months ago
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆57Updated last year
• mlcommons / mlperf_client
  MLPerf Client is a benchmark for Windows and macOS, focusing on client form factors in ML inference scenarios.
  ☆53Updated 3 weeks ago
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆40Updated 3 months ago
• intel / torch-ccl
  oneCCL Bindings for Pytorch*
  ☆102Updated 2 months ago