Alternatives and similar repositories for alpine-llama-cpp-server

Users that are interested in alpine-llama-cpp-server are comparing it to the libraries listed below

• baehyunsol / ragit
  git-like rag pipeline
  ☆244Updated last week
• avarayr / suaveui
  Open source LLM UI, compatible with all local LLM providers.
  ☆175Updated last year
• oi-overide / oi
  Overide (pronounced over·ide) is a lightweight, yet powerful CLI tool that seamlessly integrates AI-powered code generation into your dev…
  ☆185Updated 2 months ago
• iluxu / llmbasedos
  llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work
  ☆275Updated 2 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆81Updated last week
• matteoserva / GraphLLM
  ☆206Updated last month
• TheProxyCompany / proxy-structuring-engine
  Guaranteed Structured Output from any Language Model via Hierarchical State Machines
  ☆145Updated 2 weeks ago
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆51Updated 5 months ago
• logankeenan / george
  George is an API leveraging AI to make it easy to control a computer with natural language.
  ☆50Updated 9 months ago
• kalavai-net / kalavai-client
  A platform to self-host AI on easy mode
  ☆170Updated this week
• p-e-w / arrows
  A frontend for creative writing with LLMs
  ☆134Updated last year
• samuel-vitorino / lm.rs-webui
  Light WebUI for lm.rs
  ☆24Updated last year
• samas69420 / transformino
  ☆17Updated 3 months ago
• tooyipjee / ollamacode_cli
  ☆90Updated 2 weeks ago
• h2210316651 / lexicrawler
  LexiCrawler is a powerful Go-based web crawling API meticulously designed to extract, clean, and transform web page content into a pristi…
  ☆48Updated 7 months ago
• MichaelMcCulloch / WikiDex
  ☆35Updated last year
• codelion / ellora
  Enhancing LLMs with LoRA
  ☆169Updated last month
• inferx-net / inferx
  InferX: Inference as a Service Platform
  ☆136Updated last week
• DefamationStation / Retrochat-v2
  RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for eng…
  ☆81Updated 3 months ago
• phildougherty / llmsh
  *NIX SHELL with Local AI/LLM integration
  ☆23Updated 7 months ago
• shoibloya / nuggt-research
  ☆22Updated 8 months ago
• Toy-97 / Chat-WebUI
  Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools such as web search …
  ☆46Updated last month
• amanvirparhar / elara
  A simple tool to anonymize LLM prompts.
  ☆65Updated 8 months ago
• intelligencedev / eternal
  Eternal is an experimental platform for machine learning models and workflows.
  ☆67Updated 7 months ago
• severian42 / SIREN
  A Field-Theoretic Approach to Unbounded Memory in Large Language Models
  ☆20Updated 6 months ago
• m18coppola / llama.sh
  No-messing-around sh client for llama.cpp's server
  ☆30Updated last year
• teabranch / open-responses-server
  Wraps any OpenAI API interface as Responses with MCPs support so it supports Codex. Adding any missing stateful features. Ollama and Vllm…
  ☆120Updated last week
• TesslateAI / TFrameX
  ☆166Updated 2 months ago
• SomeOddCodeGuy / OfflineWikipediaTextApi
  This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …
  ☆100Updated last month
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆96Updated 3 months ago