yazon / flexllamaLinks
🚀 FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GPU support
☆45Updated 3 weeks ago
Alternatives and similar repositories for flexllama
Users that are interested in flexllama are comparing it to the libraries listed below
Sorting:
- ☆176Updated 4 months ago
- A sleek web interface for Ollama, making local LLM management and usage simple. WebOllama provides an intuitive UI to manage Ollama model…☆59Updated 2 months ago
- ☆200Updated 3 months ago
- A real-time shared memory layer for multi-agent LLM systems.☆50Updated 5 months ago
- The easiest & fastest way to run LLMs in your home lab☆72Updated 2 weeks ago
- Python language chat with Ollama models locally, anthropic and openai☆24Updated 8 months ago
- CaSIL is an advanced natural language processing system that implements a sophisticated four-layer semantic analysis architecture. It pro…☆67Updated last year
- ACE-Step: A Step Towards Music Generation Foundation Model☆46Updated 7 months ago
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools such as web search …☆47Updated 3 months ago
- Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends☆49Updated 4 months ago
- Personal voice assistant, with voice interruption and Twilio support☆18Updated 9 months ago
- Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.☆87Updated this week
- Generates breakthrough ideas from a single prompt through an 8 stage walkthrough, with optional research proposal paper.☆58Updated 2 months ago
- A web application that converts speech to speech 100% private☆81Updated 6 months ago
- Open source tool for transcirption and subtitling, alternative to happyscribe.☆31Updated 10 months ago
- the AI IDE for work, research, development, and play.☆220Updated this week
- Multi-agent autonomous research system using LangGraph and LangChain. Generates citation-backed reports with credibility scoring and web …☆90Updated last week
- ☆83Updated 9 months ago
- A persistent local memory for AI, LLMs, or Copilot in VS Code.☆181Updated last month
- Adaptive Modular Network (AMN) a potentially novel machine learning architecture capable of producing models which can learn at inference…☆54Updated 9 months ago
- Super simple python connectors for llama.cpp, including vision models (Gemma 3, Qwen2-VL). Compile llama.cpp and run!☆29Updated last week
- A stock market bot that automatically, once a day, rebalances your Robinhood portfolio by gathering information about each ticker in the …☆58Updated 9 months ago
- Integrates AI tools into Microsoft Word☆156Updated last year
- A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…☆237Updated 2 months ago
- ☆228Updated 7 months ago
- A Streamlit app for generating high-quality Q&A training datasets from text and PDFs, leveraging Gemini, Claude, and OpenAI for LLM fine-…☆38Updated 5 months ago
- ☆58Updated 10 months ago
- ☆19Updated 5 months ago
- Orpheus Chat WebUI☆74Updated 8 months ago
- Convert Files / Folders / GitHub Repos Into AI / LLM-ready Files☆164Updated 10 months ago