Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
☆150Aug 31, 2026Updated last week
Alternatives and similar repositories for llamactl
Users that are interested in llamactl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Smart OpenAI‑compatible proxy for llama.cpp: manages slots, saves/restores KV cache to disk, routes requests by prefix similarity, and pr…☆53Nov 14, 2025Updated 9 months ago
- Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc☆5,598Updated this week
- a lightning-fast, crash-proof search engine aggregator built in Rust. Focused on memory efficiency, safe character slicing, and high-per…☆15Jun 3, 2026Updated 3 months ago
- Enterprise-grade distributed AI agent framework | Develop → Deploy → Observe | K8s-native | Dynamic DI | Auto-failover | Multi-LLM | Pyth…☆40Updated this week
- Specialized AI agents for your bare metal. 100% On-Prem & Air-Gap ready.☆26Feb 21, 2026Updated 6 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A powerful and user-friendly tool that generates detailed captions for your images☆21Nov 11, 2024Updated last year
- ☆24Jan 22, 2025Updated last year
- Ubiquité : Open-source Perplexity clone with multi-LLM support and KaTeX math rendering.☆48Nov 14, 2025Updated 9 months ago
- ☆19Jul 4, 2025Updated last year
- A powerful MCP testing tool with multi-provider LLM support (Ollama, OpenAI, Claude, Gemini). Test, debug, and develop MCP servers with a…☆18Apr 28, 2026Updated 4 months ago
- 📦 One-liners to manage any binary☆15Mar 18, 2026Updated 5 months ago
- GUF to MLX Converter; LM studio advanced tips; Simple text generation using Apple's MLX framework;Enhanced MLX implementation with transf…☆38Updated this week
- A tool for adding function calling to llm api, available as a service by following the link☆22Aug 11, 2025Updated last year
- A professional Next.js blogging platform with advanced AI-driven content generation. Auto-Blog leverages RSS feed analysis and Retrieval-…☆22Oct 8, 2025Updated 11 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Scripts and tools for optimizing quantizations in llama.cpp with GGUF imatrices.☆19Jan 10, 2025Updated last year
- A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.☆36May 11, 2026Updated 3 months ago
- WebRAgent is a retrieval-augmented generation (RAG) web application featuring agent-based query decomposition, vector search with Qdrant,…☆56Mar 22, 2025Updated last year
- Проект ZapretRoblox предоставляет эффективное решение для обхода ограничений на доступ к Roblox. Использует технологии DPI-обхода через п…☆15Dec 3, 2025Updated 9 months ago
- package for create excel / pdf /html file using json template☆11Jul 26, 2023Updated 3 years ago
- A Comprehensive Speech Processing Algorithms Library for research and production use☆18Oct 25, 2025Updated 10 months ago
- Plugin for Roundcube webmail, enable virtual email sender input.☆21Sep 1, 2026Updated last week
- ☆21May 29, 2025Updated last year
- AI agent framework, written from scratch (not based on openclaw), focused on stripping it down to the bare necessities, optimizing token …☆481Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Useful Nautilus Scripts made with☆13Jul 27, 2021Updated 5 years ago
- A MCP server allowing LLM agents to easily connect and retrieve data from any database☆99Aug 1, 2025Updated last year
- A local-first web search agent☆30Jun 20, 2026Updated 2 months ago
- A download manager in GTK tailored for GNOME☆10Apr 8, 2024Updated 2 years ago
- MAESTRO is an AI-powered research application designed to streamline complex research tasks.☆1,492Apr 16, 2026Updated 4 months ago
- llama.cpp fork with additional SOTA quants and improved performance☆3,190Updated this week
- ACE-Step: A Step Towards Music Generation Foundation Model☆50May 20, 2025Updated last year
- A Streamlit app for generating high-quality Q&A training datasets from text and PDFs, leveraging Gemini, Claude, and OpenAI for LLM fine-…☆41Jul 5, 2025Updated last year
- LLamaHTML is a simple html file to communicate with a running llamacpp llama-server☆25Aug 5, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A TTS model capable of generating ultra-realistic dialogue in one pass.☆32May 1, 2025Updated last year
- StatelessChatUI is a lightweight, single-file, OpenAI-compatible chat frontend. It’s built to be portable and privacy-friendly: no accoun…☆19Dec 18, 2025Updated 8 months ago
- A markdown web renderer for AI agents — see the web without screenshots☆67Aug 28, 2026Updated last week
- Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends☆61Aug 21, 2025Updated last year
- RelateLang (former RelateScript) is a declarative meta-language designed to streamline the creation of structured and consistent prompts …☆10Mar 19, 2026Updated 5 months ago
- MCP that combats tools overload☆23Aug 9, 2025Updated last year
- A local-first, privacy-preserving alternative to Google NotebookLM — Tauri 2, React 19, Rust, Ollama☆44Updated this week