OpenVINO LLM Benchmark
☆11Dec 7, 2023Updated 2 years ago
Alternatives and similar repositories for ov_llm_bench
Users that are interested in ov_llm_bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tools for easier OpenVINO development/debugging☆10Jul 16, 2025Updated last year
- Official scripts modified by yours truly (@starhopp3r) and @jameshi16 that allow OpenVINO™ to run on Ubuntu 18.04.☆19Sep 30, 2021Updated 5 years ago
- A lightweight pure C++ Text-to-Speech (TTS) pipeline with OpenVINO, supporting multiple languages.☆114Sep 26, 2025Updated last year
- A visualizer for the ROCm Profiler Tools☆34Updated this week
- Add genai backend for ollama to run generative AI models using OpenVINO Runtime.☆32Apr 16, 2026Updated 6 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆25Jun 20, 2025Updated last year
- Semi-automated OpenVINO benchmark_app with variable parameters. User can specify multiple options for any parameters in the benchmark_app…☆10Apr 19, 2022Updated 4 years ago
- ROCm CLI is a command-line tool for setting up and running local AI on AMD GPUs, with a full-screen TUI dashboard for GPU telemetry, mode…☆51Updated this week
- ASTER 💫 : Assembly Tooling and Representations☆37Jul 1, 2026Updated 4 months ago
- Demo on iGPU for FFmpeg decode and scale, OpenVINO inference. this is zero-copy solution, which means No frame data copy from CPU to iGPU…☆17Jan 25, 2023Updated 3 years ago
- NCCL tutorial at PyTorch Conference China 2026☆27Sep 8, 2026Updated 2 months ago
- A ROCm library for GPU-Initiated IO. This provides support for initiating IO from a ROCm-capable GPU against a range of targets including…☆73Updated this week
- DEPRECATED REPOSITORY. ROCm Inference Transfer Library (RIXL) is a port of the NIXL library for AMD GPUs. See README_rocm.md for AMD spe…☆15Updated this week
- This sample shows how to use the oneAPI Video Processing Library (oneVPL) to perform a single and multi-source video decode and preproces…☆15Jun 15, 2023Updated 3 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Displaying Intel NPU usage on Linux.☆44Apr 8, 2026Updated 7 months ago
- 1 min voice data can also be used to train a good TTS model! (few shot voice cloning)☆17Apr 27, 2024Updated 2 years ago
- A practical guide to high-performance gluon kernel development on AMD GFX9 GPUs.☆58Nov 2, 2026Updated last week
- Multi-stage LLM agent pipeline for optimizing AI kernels on Intel GPU — from analysis to autotuning.☆29Updated this week
- ☆27Oct 9, 2025Updated last year
- ☆61Dec 18, 2024Updated last year
- [WWW 2025 Oral] ImageScope: Unifying Language-Guided Image Retrieval via Large Multimodal Model Collective Reasoning☆21Jul 2, 2025Updated last year
- ☆17Updated this week
- Training materials for BigDL☆13Jan 3, 2023Updated 3 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆23Mar 16, 2025Updated last year
- triton for dsa☆68Sep 20, 2026Updated last month
- A Prot paper related materials☆11Sep 5, 2022Updated 4 years ago
- Euclidean Distance Computation in Python for 4x-100x+ speedups over SciPy and scikit-learn. Also leverages GPU for better performance on…☆59Jul 24, 2017Updated 9 years ago
- An OpenMP implementation for Python2☆10Nov 25, 2017Updated 8 years ago
- Collection of C++ Coroutine sample code☆12Feb 14, 2024Updated 2 years ago
- Linq's Function Calling Agent utilizing DeepSeek-R1☆30Feb 5, 2025Updated last year
- A repository of Dockerfiles, scripts, yaml files, Helm Charts, etc. used to build and scale the sample AI workflows with python, kubernet…☆12Feb 22, 2024Updated 2 years ago
- A high-throughput and memory-efficient inference and serving engine for Whisper, https://mesolitica.com/blog/vllm-whisper☆34Jul 28, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 音频响度统一，音量归一化处理☆13Updated this week
- This is Microsoft-Phi-3-NvidiaNIMWorkshop☆22Aug 16, 2024Updated 2 years ago
- ☆11Aug 5, 2022Updated 4 years ago
- ☆11Jun 4, 2024Updated 2 years ago
- Tutorials to GPU programming. Reading notes.☆19Apr 27, 2023Updated 3 years ago
- amdgpu example code in hip/asm☆71Nov 4, 2026Updated last week
- A conda-smithy repository for ambertools.☆13Updated this week
Are these results useful?