yazon / flexllamaLinks
🚀 FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GPU support
☆30Updated 3 weeks ago
Alternatives and similar repositories for flexllama
Users that are interested in flexllama are comparing it to the libraries listed below
Sorting:
- Personal voice assistant, with voice interruption and Twilio support☆18Updated 5 months ago
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools such as web search …☆40Updated last week
- ☆161Updated last week
- CaSIL is an advanced natural language processing system that implements a sophisticated four-layer semantic analysis architecture. It pro…☆66Updated 9 months ago
- Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.☆74Updated this week
- Python language chat with Ollama models locally, anthropic and openai☆25Updated 4 months ago
- A real-time shared memory layer for multi-agent LLM systems.☆47Updated last month
- ☆81Updated 5 months ago
- ☆17Updated 8 months ago
- Realtime tts reading of large textfiles by your favourite voice. +Translation via LLM (Python script)☆52Updated 10 months ago
- ☆132Updated 3 months ago
- A sleek web interface for Ollama, making local LLM management and usage simple. WebOllama provides an intuitive UI to manage Ollama model…☆52Updated 2 months ago
- ☆55Updated last month
- ☆18Updated last month
- Open source tool for transcirption and subtitling, alternative to happyscribe.☆29Updated 6 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated 11 months ago
- ☆29Updated 3 months ago
- Moondream MCP Server in Python☆40Updated last month
- AI debugger and AI coder integrated. Use AI to code and drives runtime debugger☆52Updated last week
- 🗣️ Real‑time, low‑latency voice, vision, and conversational‑memory AI assistant built on LiveKit and local LLMs ✨☆84Updated last month
- Self-hosted AI medical scribe.☆49Updated last week
- Super simple python connectors for llama.cpp, including vision models (Gemma 3, Qwen2-VL). Compile llama.cpp and run!☆27Updated 2 weeks ago
- Crow is a Desktop AI Assistant☆31Updated last year
- ☆163Updated this week
- Convert Files / Folders / GitHub Repos Into AI / LLM-ready Files☆160Updated 6 months ago
- A unified library for interacting with various AI APIs through a standardized interface.☆31Updated 5 months ago
- An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…☆125Updated 10 months ago
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆52Updated 6 months ago
- Generates breakthrough ideas from a single prompt through an 8 stage walkthrough, with optional research proposal paper.☆56Updated 5 months ago
- ACE-Step: A Step Towards Music Generation Foundation Model☆42Updated 3 months ago