SamuelTallet / alpine-llama-cpp-serverLinks
A lightweight LLaMA.cpp HTTP server Docker image based on Alpine Linux.
☆28Updated 3 months ago
Alternatives and similar repositories for alpine-llama-cpp-server
Users that are interested in alpine-llama-cpp-server are comparing it to the libraries listed below
Sorting:
- llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work☆267Updated this week
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆67Updated last month
- A Field-Theoretic Approach to Unbounded Memory in Large Language Models☆20Updated 3 months ago
- A frontend for creative writing with LLMs☆129Updated last year
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools.☆32Updated last month
- ☆155Updated this week
- ☆16Updated last month
- ☆34Updated last year
- ☆81Updated 5 months ago
- A MCP server allowing LLM agents to easily connect and retrieve data from any database☆97Updated last week
- Simple node proxy for llama-server that enables MCP use☆13Updated 3 months ago
- A simple tool to anonymize LLM prompts.☆64Updated 6 months ago
- George is an API leveraging AI to make it easy to control a computer with natural language.☆48Updated 7 months ago
- Open source LLM UI, compatible with all local LLM providers.☆174Updated 10 months ago
- A platform to self-host AI on easy mode☆156Updated last week
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆90Updated last month
- You don’t need to read the code to understand how to build!☆202Updated 6 months ago
- This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …☆98Updated 3 weeks ago
- ☆208Updated 3 weeks ago
- Command-line personal assistant using your favorite proprietary or local models with access to over 30+ tools☆110Updated last month
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆142Updated 2 months ago
- ☆29Updated 10 months ago
- Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…☆49Updated 2 months ago
- ☆45Updated last year
- InferX is a Inference Function as a Service Platform☆123Updated 2 weeks ago
- ☆132Updated 3 months ago
- A natural language file search tool that uses LLMs to help you find files by describing what you're looking for.☆28Updated 5 months ago
- Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.☆28Updated 6 months ago
- Convert URLs into LLM-friendly markdown chunks☆65Updated 11 months ago
- RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for eng…☆77Updated 3 weeks ago