Alternatives and similar repositories for ollama-vulkan

Users that are interested in ollama-vulkan are comparing it to the libraries listed below

• whyvl / ollama-vulkan
  Fork of ollama for vulkan support
  ☆104Updated 8 months ago
• Kraftland / portable
  Fast, private and efficient Linux desktop sandbox.
  ☆54Updated last week
• dnhkng / RKLLM-Gradio
  ☆17Updated 9 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆81Updated this week
• SillyTavern / SillyTavern-WebSearch-Selenium
  Add-on for the Web Search extension that provides the web browsing capabilities without the need for Extras API.
  ☆44Updated 2 months ago
• jxqu3 / aiui
  A simple no-install web UI for Ollama and OAI-Compatible APIs!
  ☆31Updated 8 months ago
• voideditor / binaries
  ☆49Updated 3 months ago
• cyan2k / llama.cpp
  LLM inference in C/C++
  ☆23Updated last year
• spectral-compute / scale-docs
  ☆61Updated last week
• segurac / force-host-alloction-APU
  ☆63Updated 5 months ago
• ml2068 / ollamagoweb
  Golang web client for Ollama, fast and easy to use.
  ☆29Updated 3 months ago
• CachyOS / uksmd
  Userspace KSM helper daemon (CachyOS branding)
  ☆27Updated 8 months ago
• taylorchu / kokoro-onnx
  ☆24Updated 8 months ago
• PerminovEugene / messy-folder-reorganizer-ai
  🤖 AI-powered CLI for file reorganization. Runs fully locally — no data leaves your machine.
  ☆19Updated 3 months ago
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆14Updated 3 months ago
• wavify-labs / wavify-sdks
  fast state-of-the-art speech models and a runtime that runs anywhere 💥
  ☆57Updated 4 months ago
• probonopd / static-tools
  Building static binaries of some tools using an Alpine chroot with musl
  ☆33Updated 2 months ago
• Stantheman / gcompat
  glibc compatibility layer for musl (mirror) - Do not submit PRs here! Use the official Git repository ->
  ☆44Updated 6 years ago
• Thireus / GGUF-Tool-Suite
  Input your VRAM and RAM and the toolchain will produce a GGUF model tuned to your system within seconds — flexible model sizing and lowes…
  ☆58Updated this week
• ThatOneCalculator / ollamamodelupdater
  Update your Ollama models to their latest versions with Bun!
  ☆18Updated 11 months ago
• thad0ctor / llama-server-launcher
  ☆105Updated 3 weeks ago
• hamadmarri / ECHO-CPU-Scheduler
  ECHO CPU Scheduler - Enhanced CPU Handling Orchestrator It is a CPU processes scheduler patch for Linux kernel.
  ☆37Updated 7 months ago
• Danmoreng / local-qwen3-coder-env
  PowerShell scripts to easily set up and run the Qwen3-Coder GGUF model locally on Windows using the high-performance ik_llama.cpp fork.
  ☆22Updated 2 months ago
• sevenreasons / promptcat
  A zero-dependency prompt manager/catalog/library in a single HTML file. Everything is stored locally in your browser. Meow. 😼
  ☆41Updated 2 months ago
• and270 / thinking_effort_processor
  ☆93Updated 3 months ago
• qrv0 / llm-ripper
  LLM Ripper is a framework for component extraction (embeddings, attention heads, FFNs), activation capture, functional analysis, and adap…
  ☆45Updated last week
• Cyberhan123 / stable-diffusion-desktop
  Minimalist stable-diffusion desktop application with only one executable file writen with golang ( No python ).
  ☆18Updated 6 months ago
• Haidra-Org / horde-sdk
  A python library to interact with AI-Horde's free generative AI APIs
  ☆32Updated 2 weeks ago
• nazdridoy / ngpt
  🤖 nGPT - A lightning-fast CLI tool that brings any OpenAI-compatible LLM (OpenAI, Ollama, Groq, Claude, Gemini) directly to your termina…
  ☆27Updated last month
• gvlassis / gvtop
  🎮 Material You TUI for monitoring NVIDIA GPUs
  ☆57Updated 4 months ago