Alternatives and similar repositories for ov_llm_bench:

Users that are interested in ov_llm_bench are comparing it to the libraries listed below

• openvinotoolkit / openvino_tokenizers
  OpenVINO Tokenizers extension
  ☆31Updated this week
• codeplaysoftware / cutlass-fork
  CUDA Templates for Linear Algebra Subroutines
  ☆16Updated this week
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆62Updated 3 weeks ago
• openvinotoolkit / openvino.genai
  Run Generative AI models with simple C++/Python API and using OpenVINO Runtime
  ☆249Updated this week
• intel / torch-ccl
  oneCCL Bindings for Pytorch*
  ☆91Updated this week
• intel / xetla
  ☆61Updated 3 months ago
• ROCm / TransformerEngine
  ☆26Updated this week
• HabanaAI / Habana_Custom_Kernel
  Provides the examples to write and build Habana custom kernels using the HabanaTools
  ☆21Updated 4 months ago
• ROCm / pytorch-micro-benchmarking
  ☆20Updated last week
• HabanaAI / hccl_demo
  ☆20Updated 2 weeks ago
• intel / intel-extension-for-openxla
  ☆46Updated last week
• HabanaAI / DeepSpeed
  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
  ☆13Updated last month
• libxsmm / tpp-pytorch-extension
  Intel® Tensor Processing Primitives extension for Pytorch*
  ☆12Updated this week
• intel / torch-xpu-ops
  ☆37Updated this week
• reger-men / HPL_GPU
  High-Performance Linpack Benchmark adopted version for GPU backend
  ☆11Updated 2 years ago
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆172Updated this week
• OpenPPL / ppl.pmx
  ☆58Updated 4 months ago
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆56Updated 2 weeks ago
• libxsmm / parlooper
  PArallelLOOPgEneratoR: Threaded Loops Code Generation Infrastructure targeting Tensor Contraction Applications such as GEMMs, Convolution…
  ☆18Updated 3 months ago
• ROCm / apex
  A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
  ☆21Updated this week
• HabanaAI / Model-References
  Reference models for Intel(R) Gaudi(R) AI Accelerator
  ☆162Updated last month
• uxlfoundation / oneCCL
  oneAPI Collective Communications Library (oneCCL)
  ☆227Updated this week
• Intel-tensorflow / tensorflow
  Computation using data flow graphs for scalable machine learning
  ☆67Updated this week
• ROCm / MAD
  ☆16Updated this week
• MetaX-MACA / FlashMLA
  Fast and efficient attention method exploration and implementation.
  ☆19Updated last week
• BBuf / tensorrt-llm-moe
  ☆23Updated 2 months ago
• IBM / pytorch-communication-benchmarks
  pytorch code examples for measuring the performance of collective communication calls in AI workloads
  ☆16Updated 5 months ago
• north-numerical-computing / tensor-cores-numerical-behavior
  Test suite for probing the numerical behavior of NVIDIA tensor cores
  ☆37Updated 8 months ago
• intel / xFasterTransformer
  ☆410Updated last week
• triton-inference-server / openvino_backend
  OpenVINO backend for Triton.
  ☆31Updated 3 weeks ago