zhaohb / ollama_ovLinks
Add genai backend for ollama to run generative AI models using OpenVINO Runtime.
☆19Updated 6 months ago
Alternatives and similar repositories for ollama_ov
Users that are interested in ollama_ov are comparing it to the libraries listed below
Sorting:
- AMD APU compatible Ollama. Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.☆138Updated 2 weeks ago
- Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V,…☆72Updated 8 months ago
- ☆257Updated 7 months ago
- Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration☆155Updated this week
- Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.☆267Updated this week
- AMD Ryzen™ AI Software includes the tools and runtime libraries for optimizing and deploying AI inference on AMD Ryzen™ AI powered PCs.☆720Updated 2 weeks ago
- Make use of Intel Arc Series GPU to Run Ollama, StableDiffusion, Whisper and Open WebUI, for image generation, speech recognition and int…☆217Updated last month
- Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.☆572Updated this week
- AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1☆216Updated last month
- General Site for the GFX803 ROCm Stuff☆134Updated 4 months ago
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆352Updated this week
- See how to play with ROCm, run it with AMD GPUs!☆39Updated 7 months ago
- A complete package that provides you with all the components needed to get started of dive deeper into Machine Learning Workloads on Cons…☆44Updated 2 months ago
- Fast inference engine for Transformer models☆54Updated last year
- Container image for PiKVM☆38Updated last year
- Ollama with intel (i)GPU acceleration in docker and benchmark☆30Updated last week
- AI PC starter app for doing AI image creation, image stylizing, and chatbot on a PC powered by an Intel® Arc™ GPU.☆694Updated last week
- ROCm docker images with fixes/support for extra architectures, such as gfx803/gfx1010.☆31Updated 2 years ago
- Intel® NPU (Neural Processing Unit) Driver☆366Updated 2 weeks ago
- ☆179Updated 2 months ago
- The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm☆681Updated this week
- Cockpit UI for docker containers (ported from cockpit-podman)☆105Updated last week
- Docker virt-manager☆147Updated 3 years ago
- Faster whisper Running on AMD GPUs with modified CTranslate 2 Libraries served up with Wyoming protocol☆31Updated last year
- The kiwi-ng configuration used to create Rockstor 'Built on openSUSE' installers.☆42Updated 7 months ago
- A minimal docker baseimage to ease creation of long-lived application containers☆57Updated 3 weeks ago
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆405Updated this week
- Automated script to convert Huggingface and GGUF models to rkllm format for running on Rockchip NPU☆37Updated last year
- A daemon that automatically manages the performance states of NVIDIA GPUs.☆104Updated 2 months ago
- Installation scripts for running TrueCommand on various host OS's.☆19Updated 4 years ago