yazon / flexllamaLinks
🚀 FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GPU support
☆39Updated last week
Alternatives and similar repositories for flexllama
Users that are interested in flexllama are comparing it to the libraries listed below
Sorting:
- ☆173Updated 3 months ago
- Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.☆80Updated this week
- ☆19Updated 4 months ago
- Super simple python connectors for llama.cpp, including vision models (Gemma 3, Qwen2-VL). Compile llama.cpp and run!☆28Updated 3 months ago
- ☆83Updated 8 months ago
- A real-time shared memory layer for multi-agent LLM systems.☆49Updated 4 months ago
- CaSIL is an advanced natural language processing system that implements a sophisticated four-layer semantic analysis architecture. It pro…☆66Updated last year
- Personal voice assistant, with voice interruption and Twilio support☆18Updated 8 months ago
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools such as web search …☆46Updated 2 months ago
- Python language chat with Ollama models locally, anthropic and openai☆24Updated 6 months ago
- 🗣️ Real‑time, low‑latency voice, vision, and conversational‑memory AI assistant built on LiveKit and local LLMs ✨☆97Updated 4 months ago
- ACE-Step: A Step Towards Music Generation Foundation Model☆45Updated 5 months ago
- Run Orpheus 3B Locally With LM Studio☆31Updated 7 months ago
- ☆29Updated 6 months ago
- Open source tool for transcirption and subtitling, alternative to happyscribe.☆30Updated 9 months ago
- ☆28Updated 5 months ago
- the IDE for research, built from the ground up with AI integrations☆162Updated this week
- Realtime tts reading of large textfiles by your favourite voice. +Translation via LLM (Python script)☆52Updated last year
- Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.☆29Updated 9 months ago
- ☆133Updated 6 months ago
- An fully autonomous agent that accesses the browser and performs tasks.☆17Updated 6 months ago
- ☆17Updated 2 months ago
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆53Updated 9 months ago
- A sleek web interface for Ollama, making local LLM management and usage simple. WebOllama provides an intuitive UI to manage Ollama model…☆59Updated last month
- ☆73Updated 3 weeks ago
- Generates breakthrough ideas from a single prompt through an 8 stage walkthrough, with optional research proposal paper.☆57Updated last month
- A local front-end for open-weight LLMs with memory, RAG, TTS/STT, Elo ratings, and dynamic research tools. Built with React and FastAPI.☆37Updated 3 months ago
- A stock market bot that automatically, once a day, rebalances your Robinhood portfolio by gathering information about each ticker in the …☆58Updated 8 months ago
- A TTS model capable of generating ultra-realistic dialogue in one pass.☆31Updated 6 months ago
- ☆192Updated 2 months ago