zhaohb / ollama_ovLinks
Add genai backend for ollama to run generative AI models using OpenVINO Runtime.
☆14Updated 2 months ago
Alternatives and similar repositories for ollama_ov
Users that are interested in ollama_ov are comparing it to the libraries listed below
Sorting:
- AMD APU compatible Ollama. Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language mod…☆96Updated this week
- General Site for the GFX803 ROCm Stuff☆112Updated 3 weeks ago
- Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration☆40Updated this week
- ☆251Updated 3 months ago
- ☆391Updated 5 months ago
- AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1☆210Updated 6 months ago
- The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm☆379Updated this week
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆247Updated this week
- AI PC starter app for doing AI image creation, image stylizing, and chatbot on a PC powered by an Intel® Arc™ GPU.☆610Updated this week
- AMD Ryzen™ AI Software includes the tools and runtime libraries for optimizing and deploying AI inference on AMD Ryzen™ AI powered PCs.☆639Updated last month
- Run LLMs on AMD Ryzen™ AI NPUs. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.☆194Updated this week
- Make use of Intel Arc Series GPU to Run Ollama, StableDiffusion, Whisper and Open WebUI, for image generation, speech recognition and int…☆136Updated 3 months ago
- ☆53Updated last year
- No-code CLI designed for accelerating ONNX workflows☆214Updated 3 months ago
- llama.cpp fork with additional SOTA quants and improved performance☆1,181Updated this week
- Intel® NPU Acceleration Library☆689Updated 4 months ago
- Wyoming protocol server for whisper speech to text system on AMD GPUs☆11Updated last year
- ☆466Updated this week
- Automatically scale the LXC containers resources on Proxmox hosts with AI☆21Updated 2 weeks ago
- See how to play with ROCm, run it with AMD GPUs!☆34Updated 4 months ago
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆334Updated this week
- Prometheus Exporter for Ollama☆21Updated last month
- OpenVINO Tokenizers extension☆40Updated last week
- ☆15Updated 3 years ago
- Fast inference engine for Transformer models☆46Updated 10 months ago
- 8-bit CUDA functions for PyTorch☆61Updated 2 weeks ago
- Docker phpVirtualBox is a web interface that allows you to control remote VirtualBox instances v6.x☆25Updated 3 months ago
- A curated list of OpenVINO based AI projects☆154Updated 2 months ago
- ROCm docker images with fixes/support for extra architectures, such as gfx803/gfx1010.☆31Updated 2 years ago
- Everything you need to setup on your AMD system for Machine Learning Stuff☆18Updated last month