Alternatives and similar repositories for llama-swap:

Users that are interested in llama-swap are comparing it to the libraries listed below

• SomeOddCodeGuy / WilmerAI
  What If Language Models Expertly Routed All Inference? WilmerAI allows prompts to be routed to specialized workflows based on the domain …
  ☆640Updated last week
• intelligencedev / manifold
  Manifold is a platform for enabling workflow automation using AI assistants.
  ☆364Updated this week
• theroyallab / tabbyAPI
  An OAI compatible exllamav2 API that's both lightweight and fast
  ☆901Updated 3 weeks ago
• MaxHastings / Kolo
  The Fastest Way to Fine-Tune LLMs Locally
  ☆290Updated 3 weeks ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆226Updated this week
• atineiatte / deep-research-at-home
  ☆167Updated 3 weeks ago
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆152Updated this week
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆248Updated last month
• masterFoad / NanoSage
  Local LLM Powered Recursive Search & Smart Knowledge Explorer
  ☆233Updated 2 months ago
• ParisNeo / ollama_proxy_server
  A proxy server for multiple ollama instances with Key security
  ☆382Updated last week
• distantmagic / paddler
  Stateful load balancer custom-tailored for llama.cpp 🏓🦙
  ☆737Updated last week
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,379Updated this week
• avarayr / suaveui
  Open source LLM UI, compatible with all local LLM providers.
  ☆173Updated 6 months ago
• matteoserva / GraphLLM
  ☆197Updated this week
• EtiennePerot / safe-code-execution
  Code execution utilities for Open WebUI & Ollama
  ☆269Updated 5 months ago
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆491Updated 2 months ago
• neuml / rag
  🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.
  ☆352Updated 2 weeks ago
• dezoito / ollama-grid-search
  A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.
  ☆695Updated 3 months ago
• abgulati / LARS
  An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.
  ☆577Updated 5 months ago
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆214Updated 6 months ago
• Raskoll2 / LLMcalc
  A tool to determine whether or not your PC can run a given LLM
  ☆165Updated 2 months ago
• ggml-org / llama.vscode
  VS Code extension for LLM-assisted code/text completion
  ☆656Updated 3 weeks ago
• av / harbor
  Effortlessly run LLM backends, APIs, frontends, and services with one command.
  ☆1,545Updated this week
• curvedinf / dir-assistant
  Chat with your current directory's files using a local or API LLM.
  ☆344Updated last month
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆148Updated 11 months ago
• v2rockets / Loyal-Elephie
  Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible
  ☆309Updated last month
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆551Updated last month
• nick-tonjum / open-webui-artifacts-overhaul
  User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
  ☆238Updated last week
• zenoverflow / omnichain
  Efficient visual programming for AI language models
  ☆354Updated 7 months ago
• CNTRLAI / Notate
  Notate is a desktop chat application that takes AI conversations to the next level. It combines the simplicity of chat with advanced feat…
  ☆249Updated last month