Alternatives and similar repositories for ollama-vulkan

Users that are interested in ollama-vulkan are comparing it to the libraries listed below

• whyvl / ollama-vulkan
  Fork of ollama for vulkan support
  ☆110Updated 9 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆84Updated last week
• Thireus / GGUF-Tool-Suite
  Input your VRAM and RAM and the toolchain will produce a GGUF model tuned to your system within seconds — flexible model sizing and lowes…
  ☆66Updated this week
• ml2068 / ollamagoweb
  Golang web client for Ollama, fast and easy to use.
  ☆30Updated 4 months ago
• SillyTavern / SillyTavern-WebSearch-Selenium
  Add-on for the Web Search extension that provides the web browsing capabilities without the need for Extras API.
  ☆46Updated 4 months ago
• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆115Updated last year
• dnhkng / RKLLM-Gradio
  ☆18Updated 11 months ago
• Cyberhan123 / stable-diffusion-desktop
  Minimalist stable-diffusion desktop application with only one executable file writen with golang ( No python ).
  ☆18Updated 7 months ago
• PerminovEugene / messy-folder-reorganizer-ai
  🤖 AI-powered CLI for file reorganization. Runs fully locally — no data leaves your machine.
  ☆19Updated 5 months ago
• thad0ctor / llama-server-launcher
  ☆107Updated this week
• dmatora / LLM-inference-speed-benchmarks
  ☆20Updated last year
• amirrezaDev1378 / ollama-model-direct-download
  Ollama model direct link generator and installer.
  ☆222Updated 10 months ago
• mewmix / nabu
  A multi engine TTS & LLM edge computing playground with audio book features and more!
  ☆27Updated last week
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆14Updated 5 months ago
• monkesearch / monkeSearch
  fully local, temporally aware natural language file search on your pc! even without a GPU. find relevant files using natural language i…
  ☆155Updated 2 months ago
• Nexesenex / croco.cpp
  Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…
  ☆153Updated this week
• Fus3n / gem-assist
  Command-line personal assistant using your favorite proprietary or local models with access to over 30+ tools
  ☆112Updated 5 months ago
• mattjamo / OllamaToGGUF
  Convert downloaded Ollama models back into their GGUF equivalent format
  ☆66Updated 11 months ago
• CachyOS / uksmd
  Userspace KSM helper daemon (CachyOS branding)
  ☆28Updated 10 months ago
• kevkid / gguf_gui
  ☆126Updated last year
• Orion-zhen / abliteration
  Make abliterated models with transformers, easy and fast
  ☆101Updated this week
• gigit0000 / qwen3.c
  Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.
  ☆19Updated 3 months ago
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆51Updated 6 months ago
• aagdev / mlimgsynth
  Image synthesis using machine learning
  ☆22Updated 7 months ago
• cyan2k / llama.cpp
  LLM inference in C/C++
  ☆23Updated last year
• and270 / thinking_effort_processor
  ☆94Updated 5 months ago
• jxqu3 / aiui
  A simple no-install web UI for Ollama and OAI-Compatible APIs!
  ☆31Updated 10 months ago
• johnbean393 / SVGBench
  SVGBench: A challenging LLM benchmark that tests knowledge, coding, physical reasoning capabilities of LLMs.
  ☆57Updated last week
• notaDestroyer / vllm-benchmark-suite
  Benchmarking tool for vLLM inference performance with GPU monitoring
  ☆34Updated 2 weeks ago
• sasha0552 / nvidia-pstate
  A library and CLI utilities for managing performance states of NVIDIA GPUs.
  ☆31Updated last year