Alternatives and similar repositories for ov_llm_bench

Users that are interested in ov_llm_bench are comparing it to the libraries listed below

• HabanaAI / hccl_demo
  ☆23Updated last week
• reger-men / HPL_GPU
  High-Performance Linpack Benchmark adopted version for GPU backend
  ☆11Updated 3 years ago
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆63Updated 3 months ago
• HabanaAI / DeepSpeed
  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
  ☆13Updated last month
• intel / torch-xpu-ops
  ☆59Updated this week
• oneapi-src / level-zero-tests
  oneAPI Level Zero Conformance & Performance test content
  ☆57Updated this week
• PanZaifeng / RecFlex
  A recommendation model kernel optimizing system
  ☆11Updated 4 months ago
• HabanaAI / Megatron-DeepSpeed
  Intel Gaudi's Megatron DeepSpeed Large Language Models for training
  ☆13Updated 10 months ago
• ROCm / pytorch-micro-benchmarking
  ☆22Updated this week
• HabanaAI / Habana_Custom_Kernel
  Provides the examples to write and build Habana custom kernels using the HabanaTools
  ☆23Updated 6 months ago
• HabanaAI / Gaudi-tutorials
  Tutorials for running models on First-gen Gaudi and Gaudi2 for Training and Inference. The source files for the tutorials on https://dev…
  ☆61Updated last month
• intel / torch-ccl
  oneCCL Bindings for Pytorch*
  ☆102Updated 2 months ago
• ROCm-DS / hipDF
  hipDF - GPU DataFrame Library
  ☆13Updated 5 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆90Updated this week
• HabanaAI / SynapseAI_Core
  SynapseAI Core is a reference implementation of the SynapseAI API running on Habana Gaudi
  ☆43Updated 8 months ago
• LLNL / HPAC
  ☆10Updated 6 months ago
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆40Updated 2 months ago
• triton-inference-server / openvino_backend
  OpenVINO backend for Triton.
  ☆34Updated last week
• north-numerical-computing / tensor-cores-numerical-behavior
  Test suite for probing the numerical behavior of NVIDIA tensor cores
  ☆41Updated last year
• at-aaims / OpenMxP
  This is the open source version of HPL-MXP. The code performance has been verified on Frontier
  ☆17Updated 3 months ago
• ROCm / TransformerEngine
  ☆48Updated this week
• HabanaAI / Model-References
  Reference models for Intel(R) Gaudi(R) AI Accelerator
  ☆165Updated 3 weeks ago
• argonne-lcf / LLM-Inference-Bench
  LLM-Inference-Bench
  ☆55Updated 3 months ago
• shixun404 / Fault-Tolerant-SGEMM-on-NVIDIA-GPUs
  Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs
  ☆12Updated 6 months ago
• intel / sycl-tla
  SYCL* Templates for Linear Algebra (SYCL*TLA) - SYCL based CUTLASS implementation for Intel GPUs
  ☆41Updated this week
• libxsmm / tpp-pytorch-extension
  Intel® Tensor Processing Primitives extension for Pytorch*
  ☆17Updated 2 weeks ago
• mlcommons / logging
  MLPerf™ logging library
  ☆37Updated this week
• EngineCL / EngineCL
  Usability and Performance in Heterogeneous Computing. Official EngineCL repository. Peer-reviewed (FGCS).
  ☆21Updated 5 years ago
• mingfeima / pytorch_profiler_parser
  parser script to process pytorch autograd profiler result, convert json file to excel.
  ☆15Updated 6 years ago
• azrael417 / mlperf-deepcam
  This is the public repo for the MLPerf DeepCAM climate data segmentation proposal.
  ☆16Updated 3 weeks ago