Alternatives and similar repositories for llama-swap

Users that are interested in llama-swap are comparing it to the libraries listed below

• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆584Updated this week
• theroyallab / tabbyAPI
  The official API server for Exllama. OAI compatible, lightweight, and fast.
  ☆987Updated this week
• SomeOddCodeGuy / WilmerAI
  What If Language Models Expertly Routed All Inference? WilmerAI allows prompts to be routed to specialized workflows based on the domain …
  ☆705Updated this week
• intelligencedev / manifold
  Manifold is a platform for enabling workflow automation using AI assistants.
  ☆435Updated 2 weeks ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆408Updated this week
• atineiatte / deep-research-at-home
  ☆204Updated last month
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,453Updated this week
• ggml-org / llama.vscode
  VS Code extension for LLM-assisted code/text completion
  ☆807Updated this week
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆186Updated last week
• dezoito / ollama-grid-search
  A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.
  ☆757Updated 2 months ago
• mehtabmahir / easy-whisper-ui
  Easy to use interface for the Whisper model optimized for all GPUs!
  ☆221Updated this week
• lmg-anon / mikupad
  LLM Frontend in a single html file
  ☆498Updated 5 months ago
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆501Updated 4 months ago
• distantmagic / paddler
  Stateful load balancer custom-tailored for llama.cpp 🏓🦙
  ☆779Updated this week
• EtiennePerot / safe-code-execution
  Code execution utilities for Open WebUI & Ollama
  ☆285Updated 7 months ago
• SingularityMan / vector_companion
  A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…
  ☆217Updated last week
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆573Updated 4 months ago
• HazyResearch / minions
  Big & Small LLMs working together
  ☆972Updated this week
• MaxHastings / Kolo
  The Fastest Way to Fine-Tune LLMs Locally
  ☆305Updated 3 months ago
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆255Updated 3 months ago
• codelion / optillm
  Optimizing inference proxy for LLMs
  ☆2,550Updated this week
• Roy3838 / Observer
  ☆343Updated this week
• v2rockets / Loyal-Elephie
  Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible
  ☆316Updated 3 months ago
• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆109Updated this week
• masterFoad / NanoSage
  Local LLM Powered Recursive Search & Smart Knowledge Explorer
  ☆243Updated 4 months ago
• open-webui / openapi-servers
  OpenAPI Tool Servers
  ☆472Updated 2 weeks ago
• madroidmaq / mlx-omni-server
  MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…
  ☆418Updated last week
• matteoserva / GraphLLM
  ☆203Updated last month
• NPC-Worldwide / npcpy
  The AI toolkit for the AI developer
  ☆724Updated last week
• caspianmoon / memoripy
  An AI memory layer with short- and long-term storage, semantic clustering, and optional memory decay for context-aware applications.
  ☆636Updated 5 months ago