SamuelTallet / alpine-llama-cpp-server
A lightweight LLaMA.cpp HTTP server Docker image based on Alpine Linux.
☆26Updated last month
Alternatives and similar repositories for alpine-llama-cpp-server:
Users that are interested in alpine-llama-cpp-server are comparing it to the libraries listed below
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆55Updated last month
- Fast local speech-to-text for any app using faster-whisper☆61Updated 2 weeks ago
- A frontend for creative writing with LLMs☆123Updated 9 months ago
- Convert URLs into LLM-friendly markdown chunks☆64Updated 7 months ago
- George is an API leveraging AI to make it easy to control a computer with natural language.☆44Updated 3 months ago
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆71Updated 6 months ago
- A simple tool to anonymize LLM prompts.☆58Updated 2 months ago
- A Discord bot for large language models. Add Gemini, Sonnet-3.7 DeepSeek R-1, and other models. Easily change models, edit prompts, and e…☆78Updated this week
- 🔥 LitLytics - an affordable, simple analytics platform that leverages LLMs to automate data analysis☆97Updated 4 months ago
- This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …☆91Updated last week
- ☆91Updated 3 months ago
- ☆16Updated last week
- ☆45Updated 11 months ago
- A modern, POSIX-compatible, generative shell☆262Updated 3 weeks ago
- ☆44Updated 4 months ago
- Bring clippy back to windows☆43Updated 4 months ago
- A Field-Theoretic Approach to Unbounded Memory in Large Language Models☆18Updated last month
- Dou (道) - AI powered analysis and feedback for notes and mind maps☆20Updated this week
- RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for eng…☆73Updated 4 months ago
- Editor with LLM generation tree exploration☆66Updated 2 months ago
- *NIX SHELL with Local AI/LLM integration☆20Updated last month
- freeact is a lightweight library for code-action based agents☆74Updated last month
- A Pure Rust based LLM (Any LLM based MLLM such as Spark-TTS) Inference Engine, powering by Candle framework.☆93Updated 3 weeks ago
- LexiCrawler is a powerful Go-based web crawling API meticulously designed to extract, clean, and transform web page content into a pristi…☆46Updated last month
- reddacted lets you analyze & clean up your online footprint surgically by using LLMs, PII & sentiment analysis to identify that might be …☆57Updated last week
- A RAG system designed to process documents with multimodal content. It can generate factual, context-aware answers to user queries, based…☆16Updated 4 months ago
- ☆27Updated 6 months ago
- Light WebUI for lm.rs☆23Updated 6 months ago
- Turns devices into a scalable LLM platform☆128Updated this week
- EntityDB is an in-browser vector database wrapping indexedDB and Transformers.js over WebAssembly☆146Updated 3 months ago