SamuelTallet / alpine-llama-cpp-serverLinks
A lightweight LLaMA.cpp HTTP server Docker image based on Alpine Linux.
☆28Updated 3 months ago
Alternatives and similar repositories for alpine-llama-cpp-server
Users that are interested in alpine-llama-cpp-server are comparing it to the libraries listed below
Sorting:
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆87Updated this week
- ☆51Updated 3 months ago
- *NIX SHELL with Local AI/LLM integration☆24Updated 10 months ago
- ☆20Updated 11 months ago
- A frontend for creative writing with LLMs☆144Updated last year
- An educational Rust project for exporting and running inference on Qwen3 LLM family☆38Updated 5 months ago
- LexiCrawler is a powerful Go-based web crawling API meticulously designed to extract, clean, and transform web page content into a pristi…☆48Updated 10 months ago
- A simple tool to anonymize LLM prompts.☆66Updated 11 months ago
- Eternal is an experimental platform for machine learning models and workflows.☆68Updated 10 months ago
- git-like rag pipeline☆256Updated 3 weeks ago
- Open source LLM UI, compatible with all local LLM providers.☆177Updated last year
- Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…☆50Updated 8 months ago
- fully local, temporally aware natural language file search on your pc! even without a GPU. find relevant files using natural language i…☆160Updated last month
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools such as web search …☆47Updated 4 months ago
- ☆18Updated 6 months ago
- llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work☆280Updated 2 weeks ago
- George is an API leveraging AI to make it easy to control a computer with natural language.☆50Updated last year
- A natural language file search tool that uses LLMs to help you find files by describing what you're looking for.☆27Updated 10 months ago
- Wraps any OpenAI API interface as Responses with MCPs support so it supports Codex. Adding any missing stateful features. Ollama and Vllm…☆142Updated 2 months ago
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆100Updated 6 months ago
- A Field-Theoretic Approach to Unbounded Memory in Large Language Models☆20Updated 9 months ago
- A proxy server that intercepts Anthropic API requests and converts them to OpenAI-compatible format, enabling integration with dozens of …☆22Updated 2 months ago
- ☆210Updated 2 weeks ago
- ☆20Updated last year
- Cleanai (https://github.com/willmil11/cleanai) except I'm making it in c now. Fast and clean from the start this time :)☆17Updated 3 weeks ago
- InferX: Inference as a Service Platform☆146Updated this week
- ☆178Updated 5 months ago
- Notate is a desktop chat application that takes AI conversations to the next level. It combines the simplicity of chat with advanced feat…☆262Updated 10 months ago
- ☆204Updated 4 months ago
- Light WebUI for lm.rs☆24Updated last year