yazon / flexllamaLinks
🚀 FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GPU support
☆19Updated last week
Alternatives and similar repositories for flexllama
Users that are interested in flexllama are comparing it to the libraries listed below
Sorting:
- ☆28Updated last week
- ☆100Updated last month
- ☆123Updated 3 weeks ago
- This is a technical writeup of the next evolution in the Adaptive Modular Network. It aims to unify the components of the AMN and fill ga…☆56Updated last week
- Personal voice assistant, with voice interruption and Twilio support☆17Updated 3 months ago
- Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.☆49Updated this week
- Cognito: Supercharge your Chrome browser with AI. Guide, query, and control everything using natural language.☆47Updated this week
- ☆76Updated 3 months ago
- Delightful AI coding mentor | Open-source, local, hackable | 🌟 Star if it sparks delight!☆50Updated 2 months ago
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools.☆31Updated this week
- ☆182Updated 2 months ago
- ☆204Updated last month
- Generates breakthrough ideas from a single prompt through an 8 stage walkthrough, with optional research proposal paper.☆55Updated 3 months ago
- Analyze Reddit posts☆25Updated 3 months ago
- Python language chat with Ollama models locally, anthropic and openai☆25Updated 2 months ago
- ☆50Updated 4 months ago
- Dou (道) - AI powered analysis and feedback for notes and mind maps☆28Updated 2 months ago
- MAESTRO is an AI-powered research application designed to streamline complex research tasks.☆156Updated this week
- An AI engine searcher perform better than and faster than perplexity☆192Updated this week
- ACE-Step: A Step Towards Music Generation Foundation Model☆41Updated last month
- A web application that converts speech to speech 100% private☆71Updated 2 weeks ago
- Cascading voice assistant combining real-time speech recognition, AI reasoning, and neural text-to-speech capabilities.☆97Updated last month
- Open source tool for transcirption and subtitling, alternative to happyscribe.☆26Updated 4 months ago
- Open-sourced and improved memory for developers and consumers built on top of mem0.☆68Updated this week
- Enable tool/function calling for any LLM, in OpenAI and Ollama API formats, adding universal function calling to models without native su…☆41Updated last month
- ☆70Updated last month
- Whisper STT + Orpheus TTS + Gemma 3 using LM Studio to create a virtual assistant.☆60Updated last month
- “A locally hosted, memory-aware AI microservice—designed for cultural continuity, decentralized intelligence, and ethical autonomy.”☆25Updated last month
- A sleek web interface for Ollama, making local LLM management and usage simple. WebOllama provides an intuitive UI to manage Ollama model…☆51Updated 3 weeks ago
- V.I.S.O.R., my in-development AI-powered voice assistant with integrated memory!☆37Updated last month