sammysun0711 / ov_llm_benchLinks
OpenVINO LLM Benchmark
☆11Updated last year
Alternatives and similar repositories for ov_llm_bench
Users that are interested in ov_llm_bench are comparing it to the libraries listed below
Sorting:
- Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…☆61Updated 2 weeks ago
- A CUTLASS implementation using SYCL☆30Updated last week
- ☆20Updated last week
- Machine Learning Agility (MLAgility) benchmark and benchmarking tools☆39Updated 2 months ago
- oneCCL Bindings for Pytorch*☆99Updated this week
- ☆22Updated 2 months ago
- ☆40Updated this week
- ☆48Updated this week
- High-Performance Linpack Benchmark adopted version for GPU backend☆11Updated 2 years ago
- Tutorials for running models on First-gen Gaudi and Gaudi2 for Training and Inference. The source files for the tutorials on https://dev…☆62Updated 3 weeks ago
- Intel Gaudi's Megatron DeepSpeed Large Language Models for training☆13Updated 6 months ago
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆13Updated last month
- Reference models for Intel(R) Gaudi(R) AI Accelerator☆166Updated last week
- Intel® Tensor Processing Primitives extension for Pytorch*☆17Updated this week
- A novel temporal fusion framework for propelling autoregressive model inference☆11Updated this week
- Test suite for probing the numerical behavior of NVIDIA tensor cores☆40Updated 11 months ago
- COCCL: Compression and precision co-aware collective communication library☆24Updated 4 months ago
- Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs☆12Updated 3 months ago
- OpenVINO Tokenizers extension☆37Updated this week
- oneAPI Level Zero Conformance & Performance test content☆54Updated this week
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆303Updated this week
- A recommendation model kernel optimizing system☆10Updated last month
- Data and reproducibility scripts for the UoB-HPC Performance Portability studies☆17Updated last year
- ☆10Updated 3 months ago
- Provides the examples to write and build Habana custom kernels using the HabanaTools☆22Updated 3 months ago
- This is the open source version of HPL-MXP. The code performance has been verified on Frontier☆17Updated last week
- This is the public repo for the MLPerf DeepCAM climate data segmentation proposal.☆16Updated 3 years ago
- MLPerf™ logging library☆37Updated 2 months ago
- Get started with your NVIDIA Arm HPC Developers Kit!☆33Updated 2 years ago
- ☆62Updated 7 months ago