OpenVINO LLM Benchmark
☆11Dec 7, 2023Updated 2 years ago
Alternatives and similar repositories for ov_llm_bench
Users that are interested in ov_llm_bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tools for easier OpenVINO development/debugging☆10Jul 16, 2025Updated 9 months ago
- ☆22Jun 20, 2025Updated 10 months ago
- triton for dsa☆63Apr 14, 2026Updated 3 weeks ago
- Add genai backend for ollama to run generative AI models using OpenVINO Runtime.☆28Apr 16, 2026Updated 3 weeks ago
- Semi-automated OpenVINO benchmark_app with variable parameters. User can specify multiple options for any parameters in the benchmark_app…☆10Apr 19, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Displaying Intel NPU usage on Linux.☆34Apr 8, 2026Updated last month
- This sample shows how to use the oneAPI Video Processing Library (oneVPL) to perform a single and multi-source video decode and preproces…☆15Jun 15, 2023Updated 2 years ago
- [WWW 2025 Oral] ImageScope: Unifying Language-Guided Image Retrieval via Large Multimodal Model Collective Reasoning☆20Jul 2, 2025Updated 10 months ago
- A lightweight pure C++ Text-to-Speech (TTS) pipeline with OpenVINO, supporting multiple languages.☆102Sep 26, 2025Updated 7 months ago
- Demo on iGPU for FFmpeg decode and scale, OpenVINO inference. this is zero-copy solution, which means No frame data copy from CPU to iGPU…☆17Jan 25, 2023Updated 3 years ago
- Collection of best practices, optimization guides, architecture overview, performance counters☆54Feb 5, 2026Updated 3 months ago
- ☆24Oct 9, 2025Updated 7 months ago
- 1 min voice data can also be used to train a good TTS model! (few shot voice cloning)☆17Apr 27, 2024Updated 2 years ago
- ☆61Dec 18, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- OpenVINO Tokenizers extension☆50Updated this week
- Using OpenVINO to speed up MeloTTS inference☆15Nov 1, 2024Updated last year
- A Prot paper related materials☆11Sep 5, 2022Updated 3 years ago
- 音频响度统一，音量归一化处理☆13May 3, 2024Updated 2 years ago
- ☆24Mar 16, 2025Updated last year
- INACTIVE - http://mzl.la/ghe-archive - Tools to create ARPA models from cmu pocketsphinx dictionaries for proper g2p generation☆21Mar 29, 2019Updated 7 years ago
- Euclidean Distance Computation in Python for 4x-100x+ speedups over SciPy and scikit-learn. Also leverages GPU for better performance on…☆59Jul 24, 2017Updated 8 years ago
- Linq's Function Calling Agent utilizing DeepSeek-R1☆30Feb 5, 2025Updated last year
- Inference SAM in C # based on OpenVINO, ONNX runtime, TensorRT☆19Jun 6, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A repository of Dockerfiles, scripts, yaml files, Helm Charts, etc. used to build and scale the sample AI workflows with python, kubernet…☆12Feb 22, 2024Updated 2 years ago
- Fast and memory-efficient exact attention☆20Apr 30, 2026Updated last week
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆498May 1, 2026Updated last week
- ☆14May 25, 2022Updated 3 years ago
- Converting Chinese sentences into pinyin sequences, implemented in C++, very fast and easy to deploy.☆21Jan 5, 2026Updated 4 months ago
- A conda-smithy repository for ambertools.☆11Apr 23, 2026Updated 2 weeks ago
- This is Microsoft-Phi-3-NvidiaNIMWorkshop☆22Aug 16, 2024Updated last year
- ☆40Mar 19, 2026Updated last month
- Official scripts modified by yours truly (@starhopp3r) and @jameshi16 that allow OpenVINO™ to run on Ubuntu 18.04.☆19Sep 30, 2021Updated 4 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆13Nov 25, 2021Updated 4 years ago
- Data Files for "Deep diversification of an AAV capsid protein by machine learning"☆18Mar 9, 2021Updated 5 years ago
- SearchMusic是一款多平台音乐搜索和播放插件，最新更新版本号为v3。在v2版本基础之上将原来的歌曲详情回复改为音乐卡片形式，同时增加“汽水点歌”和“随机点歌”等功能，取消原来的“神秘点歌”（实际为QQ音乐，该接口已下线）。搜歌功能维持不变。☆30May 24, 2025Updated 11 months ago
- T0-GPU is a pure-Rust GPU programming framework targeting AMD RDNA3 (GFX1100) hardware. It bypasses HIP/ROCm userspace libraries entirely…☆70Apr 8, 2026Updated last month
- PArallelLOOPgEneratoR: Threaded Loops Code Generation Infrastructure targeting Tensor Contraction Applications such as GEMMs, Convolution…☆19Jan 22, 2026Updated 3 months ago
- EPOCH Input System Version 2☆10Jun 5, 2020Updated 5 years ago
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆14Jan 8, 2026Updated 4 months ago