Alternatives and similar repositories for llama-swap

Users that are interested in llama-swap are comparing it to the libraries listed below

• SomeOddCodeGuy / WilmerAI
  What If Language Models Expertly Routed All Inference? WilmerAI allows prompts to be routed to specialized workflows based on the domain …
  ☆684Updated last month
• intelligencedev / manifold
  Manifold is a platform for enabling workflow automation using AI assistants.
  ☆428Updated this week
• theroyallab / tabbyAPI
  The official API server for Exllama. OAI compatible, lightweight, and fast.
  ☆962Updated last week
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆375Updated this week
• MaxHastings / Kolo
  The Fastest Way to Fine-Tune LLMs Locally
  ☆300Updated 2 months ago
• atineiatte / deep-research-at-home
  ☆197Updated 3 weeks ago
• mehtabmahir / easy-whisper-ui
  Easy to use interface for the Whisper model optimized for all GPUs!
  ☆212Updated this week
• dezoito / ollama-grid-search
  A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.
  ☆740Updated last month
• masterFoad / NanoSage
  Local LLM Powered Recursive Search & Smart Knowledge Explorer
  ☆242Updated 3 months ago
• av / harbor
  Effortlessly run LLM backends, APIs, frontends, and services with one command.
  ☆1,702Updated 2 weeks ago
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆254Updated 2 months ago
• matteoserva / GraphLLM
  ☆202Updated 2 weeks ago
• ml-explore / mlx-lm
  Run LLMs with MLX
  ☆877Updated this week
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆153Updated last year
• lmg-anon / mikupad
  LLM Frontend in a single html file
  ☆482Updated 4 months ago
• EtiennePerot / safe-code-execution
  Code execution utilities for Open WebUI & Ollama
  ☆281Updated 6 months ago
• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆105Updated this week
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆176Updated last week
• distantmagic / paddler
  Stateful load balancer custom-tailored for llama.cpp 🏓🦙
  ☆764Updated this week
• SingularityMan / vector_companion
  A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…
  ☆217Updated last month
• madroidmaq / mlx-omni-server
  MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…
  ☆399Updated this week
• avarayr / suaveui
  Open source LLM UI, compatible with all local LLM providers.
  ☆174Updated 8 months ago
• HazyResearch / minions
  Big & Small LLMs working together
  ☆814Updated this week
• dCaples / AutoDidact
  Autonomously train research-agent LLMs on custom data using reinforcement learning and self-verification.
  ☆625Updated 2 months ago
• iluxu / llmbasedos
  Minimal Linux OS with a Model Context Protocol (MCP) gateway to expose local capabilities to LLMs.
  ☆225Updated this week
• Haervwe / open-webui-tools
  a Repository of Open-WebUI tools to use with your favourite LLMs
  ☆223Updated last week
• Blaizzy / mlx-vlm
  MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
  ☆1,293Updated this week
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆495Updated 3 months ago
• Lex-au / Orpheus-FastAPI
  High-performance Text-to-Speech server with OpenAI-compatible API, 8 voices, emotion tags, and modern web UI. Optimized for RTX GPUs.
  ☆408Updated last month
• matatonic / openedai-speech
  An OpenAI API compatible text to speech server using Coqui AI's xtts_v2 and/or piper tts as the backend.
  ☆769Updated 4 months ago