Alternatives and similar repositories for llama-swappo

Users that are interested in llama-swappo are comparing it to the libraries listed below

• k-koehler / gguf-tensor-overrider
  ☆45Updated 2 months ago
• theroyallab / YALS
  ☆85Updated last week
• pwilkin / llama-runner
  Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends
  ☆44Updated last month
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆82Updated last week
• Lanerra / saga
  Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.
  ☆79Updated this week
• Viceman256 / TensorTune
  KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning
  ☆27Updated 4 months ago
• SicariusSicariiStuff / SLOP_Detector
  SLOP Detector and analyzer based on dictionary for shareGPT JSON and text
  ☆74Updated 10 months ago
• jjziets / gddr6_temps
  Prometheus exporter for Linux​ based GDDR6/GDDR6X VRAM and GPU Core Hot spot temperature reader for NVIDIA RTX 3000/4000 series GPUs.
  ☆23Updated 11 months ago
• smy20011 / MorningRadio
  Generate Your Own Private Morning Radio for Commute
  ☆33Updated 7 months ago
• p-e-w / arrows
  A frontend for creative writing with LLMs
  ☆134Updated last year
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆163Updated last year
• avarayr / suaveui
  Open source LLM UI, compatible with all local LLM providers.
  ☆174Updated last year
• synexo / subtitler
  A utility that uses Whisper to transcribe videos and various translation APIs to translate the transcribed text and save them as SRT (sub…
  ☆72Updated last year
• FartyPants / StoryCrafter
  Writing Extension for Text Generation WebUI
  ☆63Updated last month
• Toy-97 / Chat-WebUI
  Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools such as web search …
  ☆45Updated 3 weeks ago
• PasiKoodaa / Chat-with-Screen
  ☆20Updated 11 months ago
• sanctuary-systems-com / llama_multiserver
  A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM
  ☆11Updated 3 months ago
• Independent-AI-Labs / local-super-agents
  Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…
  ☆66Updated 5 months ago
• yazon / flexllama
  🚀 FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GP…
  ☆33Updated this week
• SlerpE / highCompute.py
  ☆28Updated 3 months ago
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆80Updated last year
• Deveraux-Parker / Qwen3-Coder-30B-A3B-Monkey-Wrenches
  Efforts toward giving Qwen 3 Coder 30B A3B proper agentic tool calling capabilities at or near 100% reliability.
  ☆60Updated last month
• KartDriver / mira_converse
  ☆83Updated 6 months ago
• sasha0552 / nvidia-pstate
  A library and CLI utilities for managing performance states of NVIDIA GPUs.
  ☆28Updated 11 months ago
• crashr / gppm
  GPU Power and Performance Manager
  ☆61Updated 11 months ago
• TC-Zheng / ActuosusAI
  AI management tool
  ☆121Updated 10 months ago
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆211Updated this week
• fidecastro / llama-cpp-connector
  Super simple python connectors for llama.cpp, including vision models (Gemma 3, Qwen2-VL). Compile llama.cpp and run!
  ☆28Updated last month
• PkmX / orpheus-chat-webui
  Orpheus Chat WebUI
  ☆75Updated 5 months ago
• TheProxyCompany / proxy-structuring-engine
  Guaranteed Structured Output from any Language Model via Hierarchical State Machines
  ☆146Updated 3 months ago