bjodah / llm-multi-backend-containerLinks
Docker/podman container for llama.cpp/vllm/exllamav{2,3} orchestrated using llama-swap
☆16Updated last month
Alternatives and similar repositories for llm-multi-backend-container
Users that are interested in llm-multi-backend-container are comparing it to the libraries listed below
Sorting:
- This is a TypeScript package to add tool calling capabilities to newly released LLMs on LangChain.js's ChatOpenAI and BaseChatModel class…☆19Updated 4 months ago
- A simple, observable code-writing agent builder in TypeScript.☆28Updated 6 months ago
- A task management system designed for AI development☆58Updated 5 months ago
- MCP to explore websites with llms.txt files☆70Updated 5 months ago
- A real-time shared memory layer for multi-agent LLM systems.☆48Updated 4 months ago
- MCP GitHub Mapper is a MCP tool that will map any repository remotely and import the map directly into your code editor.☆19Updated 3 months ago
- Makes a improved prompts from a basic prompt☆43Updated 4 months ago
- ☆38Updated 3 months ago
- An fully autonomous agent that accesses the browser and performs tasks.☆17Updated 6 months ago
- the agentic shell that takes you to the stars☆78Updated last week
- open-source, local-first AI CLI for developers. It connects to your local Ollama models or remote providers like OpenAI, Anthropic, Gemin…☆47Updated last week
- ☆12Updated 5 months ago
- A complete, production-ready implementation of a Model Context Protocol (MCP) server demonstrating OAuth 2.1, tools, prompts, resources, …☆87Updated 3 months ago
- A QT GUI for large language models☆39Updated last year
- Local LLM enabled Human terminal interaction made easy.☆16Updated 10 months ago
- High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model di…☆107Updated last week
- A simple to use python library for creating podcasts with support for many LLM and TTS providers☆69Updated last week
- Easily create and deploy configurable Roo Code config packs!☆45Updated 5 months ago
- This is a cross-platform desktop application that allows you to chat with locally hosted LLMs and enjoy features like MCP support☆224Updated 2 months ago
- ☆28Updated last year
- A conversational UI for chatbots using the llama.cpp server☆13Updated 5 months ago
- Provide AI MCP server args during runtime.☆66Updated 7 months ago
- AI powered Chatbot with real time updates.☆66Updated last year
- ☆29Updated 4 months ago
- A web-based GUI tool for managing Model Context Protocol (MCP) servers in Claude and Cursor☆48Updated 10 months ago
- Smart-Thinking is a Model Context Protocol (MCP) server that delivers graph-based, multi-step reasoning without relying on external AI AP…☆27Updated last month
- MindBridge is an AI orchestration MCP server that lets any app talk to any LLM — OpenAI, Anthropic, DeepSeek, Ollama, and more — through …☆23Updated 4 months ago
- TLS & API keys for your LLM APIs☆18Updated 10 months ago
- ☆23Updated 5 months ago
- Cognito: Supercharge your Chrome browser with AI. Guide, query, and control everything using natural language.☆55Updated last month