OpenVINO LLM Benchmark
☆11Dec 7, 2023Updated 2 years ago
Alternatives and similar repositories for ov_llm_bench
Users that are interested in ov_llm_bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tools for easier OpenVINO development/debugging☆10Jul 16, 2025Updated 8 months ago
- ☆21Jun 20, 2025Updated 9 months ago
- triton for dsa☆60Mar 19, 2026Updated last week
- Add genai backend for ollama to run generative AI models using OpenVINO Runtime.☆23Jun 20, 2025Updated 9 months ago
- Semi-automated OpenVINO benchmark_app with variable parameters. User can specify multiple options for any parameters in the benchmark_app…☆10Apr 19, 2022Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Displaying Intel NPU usage on Linux.☆29Aug 19, 2025Updated 7 months ago
- This sample shows how to use the oneAPI Video Processing Library (oneVPL) to perform a single and multi-source video decode and preproces…☆15Jun 15, 2023Updated 2 years ago
- [WWW 2025 Oral] ImageScope: Unifying Language-Guided Image Retrieval via Large Multimodal Model Collective Reasoning☆20Jul 2, 2025Updated 8 months ago
- A lightweight pure C++ Text-to-Speech (TTS) pipeline with OpenVINO, supporting multiple languages.☆95Sep 26, 2025Updated 6 months ago
- Demo on iGPU for FFmpeg decode and scale, OpenVINO inference. this is zero-copy solution, which means No frame data copy from CPU to iGPU…☆17Jan 25, 2023Updated 3 years ago
- Collection of best practices, optimization guides, architecture overview, performance counters☆53Feb 5, 2026Updated last month
- ☆24Oct 9, 2025Updated 5 months ago
- 1 min voice data can also be used to train a good TTS model! (few shot voice cloning)☆17Apr 27, 2024Updated last year
- ☆60Dec 18, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- OpenVINO Tokenizers extension☆49Updated this week
- Using OpenVINO to speed up MeloTTS inference☆15Nov 1, 2024Updated last year
- A Prot paper related materials☆11Sep 5, 2022Updated 3 years ago
- 音频响度统一，音量归一化 处理☆13May 3, 2024Updated last year
- ☆24Mar 16, 2025Updated last year
- INACTIVE - http://mzl.la/ghe-archive - Tools to create ARPA models from cmu pocketsphinx dictionaries for proper g2p generation☆21Mar 29, 2019Updated 7 years ago
- Euclidean Distance Computation in Python for 4x-100x+ speedups over SciPy and scikit-learn. Also leverages GPU for better performance on…☆59Jul 24, 2017Updated 8 years ago
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆470Mar 20, 2026Updated last week
- Linq's Function Calling Agent utilizing DeepSeek-R1☆30Feb 5, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Inference SAM in C # based on OpenVINO, ONNX runtime, TensorRT☆19Jun 6, 2024Updated last year
- A repository of Dockerfiles, scripts, yaml files, Helm Charts, etc. used to build and scale the sample AI workflows with python, kubernet…☆12Feb 22, 2024Updated 2 years ago
- Fast and memory-efficient exact attention☆19Mar 9, 2026Updated 3 weeks ago
- ☆14May 25, 2022Updated 3 years ago
- Converting Chinese sentences into pinyin sequences, implemented in C++, very fast and easy to deploy.☆21Jan 5, 2026Updated 2 months ago
- A conda-smithy repository for ambertools.☆11Mar 17, 2026Updated last week
- This is Microsoft-Phi-3-NvidiaNIMWorkshop☆22Aug 16, 2024Updated last year
- ☆35Mar 19, 2026Updated last week
- Official scripts modified by yours truly (@starhopp3r) and @jameshi16 that allow OpenVINO™ to run on Ubuntu 18.04.☆19Sep 30, 2021Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆13Nov 25, 2021Updated 4 years ago
- Data Files for "Deep diversification of an AAV capsid protein by machine learning"☆18Mar 9, 2021Updated 5 years ago
- SearchMusic是一款多平台音乐搜索和播放插件，最新更新版本号为v3。在v2版本基础之上将原来的歌曲详情回复改为音乐卡片形式，同时增加“汽水点歌”和“随机点歌”等功能，取消原来的“神秘点歌”（实际为QQ音乐，该接口已下线）。搜歌功能维持不变。☆29May 24, 2025Updated 10 months ago
- PArallelLOOPgEneratoR: Threaded Loops Code Generation Infrastructure targeting Tensor Contraction Applications such as GEMMs, Convolution…☆19Jan 22, 2026Updated 2 months ago
- EPOCH Input System Version 2☆10Jun 5, 2020Updated 5 years ago
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆14Jan 8, 2026Updated 2 months ago
- Assets for AnyLabeling app☆14May 5, 2023Updated 2 years ago