yazon / flexllamaLinks
🚀 FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GPU support
☆48Updated 2 months ago
Alternatives and similar repositories for flexllama
Users that are interested in flexllama are comparing it to the libraries listed below
Sorting:
- ☆178Updated 5 months ago
- Python language chat with Ollama models locally, anthropic and openai☆24Updated 9 months ago
- Personal voice assistant, with voice interruption and Twilio support☆18Updated 11 months ago
- ☆205Updated 4 months ago
- Open source tool for transcirption and subtitling, alternative to happyscribe.☆33Updated 11 months ago
- ☆83Updated 11 months ago
- Super simple python connectors for llama.cpp, including vision models (Gemma 3, Qwen2-VL). Compile llama.cpp and run!☆29Updated last month
- ☆19Updated 6 months ago
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools such as web search …☆48Updated 5 months ago
- Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.☆92Updated this week
- Explore the unknown, build the future, own your data.☆234Updated this week
- A sleek web interface for Ollama, making local LLM management and usage simple. WebOllama provides an intuitive UI to manage Ollama model…☆65Updated 3 months ago
- ACE-Step: A Step Towards Music Generation Foundation Model☆47Updated 8 months ago
- Local LLM Powered Recursive Search & Smart Knowledge Explorer☆259Updated 3 months ago
- A real-time shared memory layer for multi-agent LLM systems.☆53Updated 3 weeks ago
- ☆58Updated 11 months ago
- 🗣️ Real‑time, low‑latency voice, vision, and conversational‑memory AI assistant built on LiveKit and local LLMs ✨☆105Updated 7 months ago
- A web application that converts speech to speech 100% private☆82Updated 8 months ago
- ☆200Updated 10 months ago
- Integrates AI tools into Microsoft Word☆157Updated last year
- OLLama IMage CAtegorizer☆70Updated last year
- The most feature-complete local AI workstation. Multi-GPU inference, integrated Stable Diffusion + ADetailer, voice cloning, research-gra…☆52Updated this week
- Multi-agent autonomous research system using LangGraph and LangChain. Generates citation-backed reports with credibility scoring and web …☆124Updated last month
- Run Orpheus 3B Locally With LM Studio☆32Updated 10 months ago
- Generates breakthrough ideas from a single prompt through an 8 stage walkthrough, with optional research proposal paper.☆61Updated 4 months ago
- Realtime tts reading of large textfiles by your favourite voice. +Translation via LLM (Python script)☆52Updated last year
- Analyze Reddit posts☆29Updated 11 months ago
- CaSIL is an advanced natural language processing system that implements a sophisticated four-layer semantic analysis architecture. It pro…☆67Updated last year
- The easiest & fastest way to run LLMs in your home lab☆78Updated last month
- ☆27Updated 7 months ago