SamuelTallet / alpine-llama-cpp-server
A lightweight LLaMA.cpp HTTP server Docker image based on Alpine Linux.
☆25Updated last week
Alternatives and similar repositories for alpine-llama-cpp-server:
Users that are interested in alpine-llama-cpp-server are comparing it to the libraries listed below
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆53Updated this week
- George is an API leveraging AI to make it easy to control a computer with natural language.☆42Updated last month
- A frontend for creative writing with LLMs☆117Updated 7 months ago
- transparent proxy server for llama.cpp's server to provide automatic model swapping☆187Updated this week
- This project is a reverse-engineered version of Figma's tone changer. It uses Groq's Llama-3-8b for high-speed inference and to adjust th…☆88Updated 6 months ago
- Eternal is an experimental platform for machine learning models and workflows.☆68Updated 6 months ago
- An open source, Gradio-based chatbot app that combines the best of retrieval augmented generation and prompt engineering into an intellig…☆48Updated 6 months ago
- Open source LLM UI, compatible with all local LLM providers.☆171Updated 5 months ago
- CaSIL is an advanced natural language processing system that implements a sophisticated four-layer semantic analysis architecture. It pro…☆64Updated 3 months ago
- Turns devices into a scalable LLM platform☆117Updated this week
- RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for eng…☆70Updated 2 months ago
- ☆45Updated 9 months ago
- This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …☆76Updated 3 weeks ago
- Editor with LLM generation tree exploration☆62Updated last week
- GPU Power and Performance Manager☆55Updated 4 months ago
- V.I.S.O.R., my in-development AI-powered voice assistant with integrated memory!☆33Updated 2 months ago
- ☆44Updated last month
- ☆30Updated 9 months ago
- ☆24Updated 3 weeks ago
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆72Updated 2 months ago
- A bot that checks your grammar and phrasing using LLM of choice☆29Updated 2 weeks ago
- Light WebUI for lm.rs☆23Updated 4 months ago
- A simple and clear way of hosting llama.cpp as a private HTTP API using Rust☆26Updated 8 months ago
- OLLama IMage CAtegorizer☆64Updated last month
- SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…☆24Updated last month
- Draft42 - Streamlit chatbot with function calling☆31Updated 10 months ago
- Something similar to Apple Intelligence?☆59Updated 7 months ago