Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
☆158Oct 15, 2026Updated this week
Alternatives and similar repositories for llamactl
Users that are interested in llamactl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc☆6,013Updated this week
- Smart OpenAI‑compatible proxy for llama.cpp: manages slots, saves/restores KV cache to disk, routes requests by prefix similarity, and pr…☆56Sep 16, 2026Updated last month
- Enterprise-grade distributed AI agent framework | Develop → Deploy → Observe | K8s-native | Dynamic DI | Auto-failover | Multi-LLM | Pyth…☆41Oct 5, 2026Updated 2 weeks ago
- a lightning-fast, crash-proof search engine aggregator built in Rust. Focused on memory efficiency, safe character slicing, and high-per…☆17Oct 3, 2026Updated 2 weeks ago
- Specialized AI agents for your bare metal. 100% On-Prem & Air-Gap ready.☆25Feb 21, 2026Updated 7 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A powerful and user-friendly tool that generates detailed captions for your images☆21Nov 11, 2024Updated last year
- ☆24Jan 22, 2025Updated last year
- The all-in-one AI assistant for development and content creation☆16Aug 12, 2026Updated 2 months ago
- Ubiquité : Open-source Perplexity clone with multi-LLM support and KaTeX math rendering.☆50Nov 14, 2025Updated 11 months ago
- Local AI coding agent harness for AMD Strix Halo (Ryzen AI Max+ 395): Qwen3.8 125B on the iGPU, NPU side-jobs, crash recovery, logged ben…☆29Updated this week
- A powerful MCP testing tool with multi-provider LLM support (Ollama, OpenAI, Claude, Gemini). Test, debug, and develop MCP servers with a…☆18Apr 28, 2026Updated 5 months ago
- A professional Next.js blogging platform with advanced AI-driven content generation. Auto-Blog leverages RSS feed analysis and Retrieval-…☆22Oct 8, 2025Updated last year
- Portable C++17 implementation of YuE2 AI Music Generator using GGML. Text + lyrics in, stereo 48kHz MP3 or WAV out. Runs on CPU, CUDA, RO…☆43Updated this week
- handwritten harness for AI, not vibecoded, everything is a module/plugin, tailor made for use with local models, tiny system prompt (arou…☆516Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A tool for adding function calling to llm api, available as a service by following the link☆22Aug 11, 2025Updated last year
- A clear, honest macOS storage cleanup utility☆17Sep 12, 2026Updated last month
- ES Lint for LLM context☆49Aug 15, 2026Updated 2 months ago
- WebRAgent is a retrieval-augmented generation (RAG) web application featuring agent-based query decomposition, vector search with Qdrant,…☆56Mar 22, 2025Updated last year
- ☆21May 29, 2025Updated last year
- A fast diffusion model engine for image generation and editing.☆35Updated this week
- ☆52Jul 28, 2026Updated 2 months ago
- Scripts and tools for optimizing quantizations in llama.cpp with GGUF imatrices.☆19Jan 10, 2025Updated last year
- A Comprehensive Speech Processing Algorithms Library for research and production use☆18Oct 25, 2025Updated 11 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Document Management System with Machine Learning and Document Workflow and Routing☆19Oct 6, 2024Updated 2 years ago
- Plugin for Roundcube webmail, enable virtual email sender input.☆22Updated this week
- Useful Nautilus Scripts made with☆13Jul 27, 2021Updated 5 years ago
- A MCP server allowing LLM agents to easily connect and retrieve data from any database☆99Aug 1, 2025Updated last year
- Long-term memory for AI coding agents (Claude Code, Codex, opencode) as a tree of plain files☆33Oct 12, 2026Updated last week
- The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own …☆106Updated this week
- llama.cpp fork with additional SOTA quants and improved performance☆3,310Updated this week
- ☆17Oct 27, 2025Updated 11 months ago
- A local-first web search agent☆30Jun 20, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Cost-optimised agent router for Claude Code: sends every sub-task to the cheapest model that can do it, and escalates only on verified fa…☆37Oct 6, 2026Updated last week
- A TTS model capable of generating ultra-realistic dialogue in one pass.☆32May 1, 2025Updated last year
- High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model di…☆321Updated this week
- A fast, native desktop reader for Open Knowledge Format bundles. Point it at a folder to explore concepts, follow links, and see the stru…☆46Sep 3, 2026Updated last month
- llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.☆280Updated this week
- LLamaHTML is a simple html file to communicate with a running llamacpp llama-server☆25Updated this week
- Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends☆61Aug 21, 2025Updated last year