SamuelTallet / alpine-llama-cpp-serverLinks
A lightweight LLaMA.cpp HTTP server Docker image based on Alpine Linux.
☆29Updated 4 months ago
Alternatives and similar repositories for alpine-llama-cpp-server
Users that are interested in alpine-llama-cpp-server are comparing it to the libraries listed below
Sorting:
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆88Updated this week
- llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work☆282Updated last month
- git-like rag pipeline☆256Updated last month
- A frontend for creative writing with LLMs☆146Updated last year
- Eternal is an experimental platform for machine learning models and workflows.☆68Updated 10 months ago
- An educational Rust project for exporting and running inference on Qwen3 LLM family☆40Updated 6 months ago
- *NIX SHELL with Local AI/LLM integration☆24Updated 11 months ago
- Aggregates compute from spare GPU capacity☆190Updated this week
- Open source LLM UI, compatible with all local LLM providers.☆177Updated last year
- This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …☆103Updated 5 months ago
- RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for eng…☆84Updated 6 months ago
- A Field-Theoretic Approach to Unbounded Memory in Large Language Models☆20Updated 9 months ago
- Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…☆50Updated 8 months ago
- George is an API leveraging AI to make it easy to control a computer with natural language.☆50Updated last year
- A natural language file search tool that uses LLMs to help you find files by describing what you're looking for.☆27Updated 10 months ago
- ☆178Updated 5 months ago
- This is a cross-platform desktop application that allows you to chat with locally hosted LLMs and enjoy features like MCP support☆227Updated 5 months ago
- Wraps any OpenAI API interface as Responses with MCPs support so it supports Codex. Adding any missing stateful features. Ollama and Vllm…☆149Updated 3 months ago
- No-messing-around sh client for llama.cpp's server☆30Updated last year
- ☆27Updated 7 months ago
- High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model di…☆133Updated last week
- ☆113Updated 3 months ago
- ☆51Updated 4 months ago
- RocketRAG is a high-performance Retrieval-Augmented Generation (RAG) system designed with a focus on speed, simplicity, and extensibility…☆77Updated 5 months ago
- Enhancing LLMs with LoRA☆206Updated 3 months ago
- ☆80Updated 2 weeks ago
- ☆20Updated last year
- ☆209Updated last month
- Orchestrator Kit for Agentic Reasoning - OrKa is a modular AI orchestration system that transforms Large Language Models (LLMs) into comp…☆88Updated 3 weeks ago
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools such as web search …☆49Updated 5 months ago