zhaohb / ollama_ovLinks
Add genai backend for ollama to run generative AI models using OpenVINO Runtime.
☆9Updated last week
Alternatives and similar repositories for ollama_ov
Users that are interested in ollama_ov are comparing it to the libraries listed below
Sorting:
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆282Updated this week
- ☆110Updated last month
- Lightweight Inference server for OpenVINO☆180Updated this week
- ☆247Updated last month
- Tools for easier OpenVINO development/debugging☆9Updated 2 months ago
- Make use of Intel Arc Series GPU to Run Ollama, StableDiffusion and Open WebUI, for image generation and interaction with Large Language …☆32Updated 2 weeks ago
- AMD APU compatible Ollama. Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language mod…☆42Updated this week
- AI PC starter app for doing AI image creation, image stylizing, and chatbot on a PC powered by an Intel® Arc™ GPU.☆548Updated this week
- AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1☆204Updated 3 months ago
- OpenVINO Tokenizers extension☆35Updated this week
- An innovative library for efficient LLM inference via low-bit quantization☆348Updated 9 months ago
- ☆528Updated 2 weeks ago
- With OpenVINO Test Drive, users can run large language models (LLMs) and models trained by Intel Geti on their devices, including AI PCs …☆26Updated 2 weeks ago
- ☆8Updated 9 months ago
- No-code CLI designed for accelerating ONNX workflows☆192Updated 3 weeks ago
- Ollama with intel (i)GPU acceleration in docker and benchmark☆14Updated this week
- The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…☆207Updated 2 weeks ago
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆467Updated this week
- AMD related optimizations for transformer models☆77Updated 7 months ago
- ☆71Updated last month
- 8-bit CUDA functions for PyTorch☆53Updated 3 weeks ago
- ☆52Updated last year
- Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…☆61Updated 3 months ago
- A curated list of OpenVINO based AI projects☆134Updated 5 months ago
- A collection of examples for the ROCm software stack☆216Updated this week
- AI Tensor Engine for ROCm☆201Updated this week
- ROCm docker images with fixes/support for extra architectures, such as gfx803/gfx1010.☆30Updated last year
- OpenVINO Intel NPU Compiler☆56Updated this week
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆13Updated 2 weeks ago
- Run LLM Agents on Ryzen AI PCs in Minutes☆393Updated this week