yazon / flexllamaLinks
π FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GPU support
β23Updated last month
Alternatives and similar repositories for flexllama
Users that are interested in flexllama are comparing it to the libraries listed below
Sorting:
- β106Updated 2 months ago
- β145Updated last week
- A real-time shared memory layer for multi-agent LLM systems.β41Updated 2 weeks ago
- β28Updated last month
- Generates breakthrough ideas from a single prompt through an 8 stage walkthrough, with optional research proposal paper.β56Updated 4 months ago
- AI debugger and AI coder integrated. Use AI to code and drives runtime debuggerβ44Updated this week
- CaSIL is an advanced natural language processing system that implements a sophisticated four-layer semantic analysis architecture. It proβ¦β66Updated 8 months ago
- Personal voice assistant, with voice interruption and Twilio supportβ18Updated 4 months ago
- Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.β67Updated this week
- A sleek web interface for Ollama, making local LLM management and usage simple. WebOllama provides an intuitive UI to manage Ollama modelβ¦β53Updated last month
- ACE-Step: A Step Towards Music Generation Foundation Modelβ41Updated last month
- Cognito: Supercharge your Chrome browser with AI. Guide, query, and control everything using natural language.β52Updated this week
- Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.β28Updated 5 months ago
- An fully autonomous agent that accesses the browser and performs tasks.β17Updated 2 months ago
- β205Updated 2 months ago
- β80Updated 4 months ago
- Python language chat with Ollama models locally, anthropic and openaiβ25Updated 2 months ago
- Local LLM Powered Recursive Search & Smart Knowledge Explorerβ244Updated 5 months ago
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools.β32Updated 3 weeks ago
- a Repository of Open-WebUI tools to use with your favourite LLMsβ240Updated 3 weeks ago
- β53Updated 2 weeks ago
- Realtime tts reading of large textfiles by your favourite voice. +Translation via LLM (Python script)β52Updated 8 months ago
- Convert Files / Folders / GitHub Repos Into AI / LLM-ready Filesβ159Updated 5 months ago
- Allows two LLMs to communicate and run code in the terminalβ26Updated 7 months ago
- β131Updated 2 months ago
- This is a technical writeup of the next evolution in the Adaptive Modular Network. It aims to unify the components of the AMN and fill gaβ¦β56Updated 2 weeks ago
- A unified library for interacting with various AI APIs through a standardized interface.β31Updated 3 months ago
- AI planner similar to OpenAI's deep researchβ197Updated this week
- LLM search engine faster than perplexity!β272Updated last week
- You donβt need to read the code to understand how to build!β201Updated 5 months ago