Alternatives and similar repositories for llama-swap

Users that are interested in llama-swap are comparing it to the libraries listed below

• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆1,587Updated this week
• theroyallab / tabbyAPI
  The official API server for Exllama. OAI compatible, lightweight, and fast.
  ☆1,121Updated 2 weeks ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆622Updated last week
• SomeOddCodeGuy / WilmerAI
  WilmerAI is one of the oldest LLM semantic routers. It uses multi-layer prompt routing and complex workflows to allow you to not only cre…
  ☆801Updated last month
• kyuz0 / amd-strix-halo-toolboxes
  ☆857Updated last week
• intelligencedev / manifold
  Manifold is an experimental platform for enabling long horizon workflow automation using teams of AI assistants.
  ☆478Updated this week
• Roy3838 / Observer
  ☆1,243Updated this week
• ggml-org / llama.vscode
  VS Code extension for LLM-assisted code/text completion
  ☆1,139Updated 2 weeks ago
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,641Updated 2 weeks ago
• lemonade-sdk / lemonade
  Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https…
  ☆2,086Updated this week
• av / harbor
  Effortlessly run LLM backends, APIs, frontends, and services with one command.
  ☆2,389Updated last week
• NPC-Worldwide / npcpy
  The python library for research and development in NLP, multimodal LLMs, Agents, ML, Knowledge Graphs, and more.
  ☆1,188Updated this week
• dezoito / ollama-grid-search
  A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.
  ☆905Updated 2 months ago
• iuliaturc / gguf-docs
  Docs for GGUF quantization (unofficial)
  ☆361Updated 6 months ago
• atineiatte / deep-research-at-home
  ☆230Updated 8 months ago
• lmg-anon / mikupad
  LLM Frontend in a single html file
  ☆692Updated last month
• sammcj / gollama
  Go manage your Ollama models
  ☆1,660Updated last month
• matatonic / openedai-speech
  An OpenAI API compatible text to speech server using Coqui AI's xtts_v2 and/or piper tts as the backend.
  ☆849Updated last year
• intentee / paddler
  Open-source LLM load balancer and serving platform for self-hosting LLMs at scale 🏓🦙
  ☆1,430Updated 2 weeks ago
• MaxHastings / Kolo
  The Fastest Way to Fine-Tune LLMs Locally
  ☆333Updated last month
• SearchSavior / OpenArc
  Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
  ☆290Updated last week
• HazyResearch / minions
  Big & Small LLMs working together
  ☆1,258Updated this week
• v2rockets / Loyal-Elephie
  Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible
  ☆346Updated 11 months ago
• FastFlowLM / FastFlowLM
  Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
  ☆689Updated this week
• rmusser01 / tldw_server
  tl/dw (Too Long, Didn't Watch): Your Personal Research Multi-Tool - a naive attempt at 'A Young Lady's Illustrated Primer' (Open Source N…
  ☆1,237Updated this week
• open-webui / openapi-servers
  OpenAPI Tool Servers
  ☆821Updated 4 months ago
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆513Updated 11 months ago
• sasha0552 / nvidia-pstated
  A daemon that automatically manages the performance states of NVIDIA GPUs.
  ☆110Updated 3 months ago
• varunvasudeva1 / llm-server-docs
  End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model manage…
  ☆674Updated this week
• Raskoll2 / LLMcalc
  A tool to determine whether or not your PC can run a given LLM
  ☆167Updated last year