zhaohb / ollama_ovLinks
Add genai backend for ollama to run generative AI models using OpenVINO Runtime.
☆18Updated 5 months ago
Alternatives and similar repositories for ollama_ov
Users that are interested in ollama_ov are comparing it to the libraries listed below
Sorting:
- AMD APU compatible Ollama. Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.☆133Updated last week
- ☆258Updated 6 months ago
- Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration☆129Updated this week
- General Site for the GFX803 ROCm Stuff☆127Updated 3 months ago
- Make use of Intel Arc Series GPU to Run Ollama, StableDiffusion, Whisper and Open WebUI, for image generation, speech recognition and int…☆205Updated last week
- Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.☆518Updated this week
- Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.☆260Updated last week
- AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1☆216Updated 2 weeks ago
- This is a one-click install script to enable Gen 12/13 Intel vGPU using SR-IOV Technology so up to 7 Client VMs can enjoy hardware GPU de…☆76Updated last year
- ☆417Updated 8 months ago
- AMD Ryzen™ AI Software includes the tools and runtime libraries for optimizing and deploying AI inference on AMD Ryzen™ AI powered PCs.☆708Updated 3 weeks ago
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆338Updated this week
- Everything you need to setup on your AMD system for Machine Learning Stuff☆19Updated 4 months ago
- ☆154Updated last month
- Faster whisper Running on AMD GPUs with modified CTranslate 2 Libraries served up with Wyoming protocol☆29Updated last year
- A small guide to help user correctly passthrough their GPUs to an unprivileged LXC container☆27Updated 9 months ago
- ☆52Updated 2 years ago
- Make PyTorch models at least run on APUs.☆56Updated last year
- Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V,…☆67Updated 7 months ago
- The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm☆613Updated this week
- Fork of ollama for vulkan support☆110Updated 9 months ago
- See how to play with ROCm, run it with AMD GPUs!☆38Updated 7 months ago
- ☆496Updated last week
- Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc☆2,025Updated this week
- Run LLM Agents on Ryzen AI PCs in Minutes☆792Updated this week
- Successfull iGPU passthrough via SR-IOV on Raptor Lake i5-13600K to Win10/11 VMs with Looking Glass☆17Updated last year
- AI PC starter app for doing AI image creation, image stylizing, and chatbot on a PC powered by an Intel® Arc™ GPU.☆674Updated last week
- A complete package that provides you with all the components needed to get started of dive deeper into Machine Learning Workloads on Cons…☆42Updated last month
- ZFS Snapshot Browser Based GUI☆46Updated last year
- ☆235Updated 2 years ago