Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
☆143Aug 18, 2026Updated this week
Alternatives and similar repositories for llamactl
Users that are interested in llamactl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Smart OpenAI‑compatible proxy for llama.cpp: manages slots, saves/restores KV cache to disk, routes requests by prefix similarity, and pr…☆51Nov 14, 2025Updated 9 months ago
- Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc☆5,402Updated this week
- a lightning-fast, crash-proof search engine aggregator built in Rust. Focused on memory efficiency, safe character slicing, and high-per…☆15Jun 3, 2026Updated 2 months ago
- Enterprise-grade distributed AI agent framework | Develop → Deploy → Observe | K8s-native | Dynamic DI | Auto-failover | Multi-LLM | Pyth…☆38Updated this week
- ☆21Aug 29, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Specialized AI agents for your bare metal. 100% On-Prem & Air-Gap ready.☆26Feb 21, 2026Updated 5 months ago
- A powerful and user-friendly tool that generates detailed captions for your images☆21Nov 11, 2024Updated last year
- ☆24Jan 22, 2025Updated last year
- Ubiquité : Open-source Perplexity clone with multi-LLM support and KaTeX math rendering.☆48Nov 14, 2025Updated 9 months ago
- Ubuntu-24.04-LXC-Desktop for Proxmox☆24Nov 13, 2024Updated last year
- Open-source options gamma exposure (GEX) & positioning dashboard — dealer GEX, max pain, open interest, IV surface. Self-hosted, Docker, …☆51Updated this week
- A powerful MCP testing tool with multi-provider LLM support (Ollama, OpenAI, Claude, Gemini). Test, debug, and develop MCP servers with a…☆18Apr 28, 2026Updated 3 months ago
- 📦 One-liners to manage any binary☆15Mar 18, 2026Updated 5 months ago
- GUF to MLX Converter; LM studio advanced tips; Simple text generation using Apple's MLX framework;Enhanced MLX implementation with transf…☆36Jul 9, 2026Updated last month
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A tool for adding function calling to llm api, available as a service by following the link☆22Aug 11, 2025Updated last year
- A professional Next.js blogging platform with advanced AI-driven content generation. Auto-Blog leverages RSS feed analysis and Retrieval-…☆22Oct 8, 2025Updated 10 months ago
- Scripts and tools for optimizing quantizations in llama.cpp with GGUF imatrices.☆19Jan 10, 2025Updated last year
- A blazingly fast and resource-efficient Docker management TUI built for VPS environments☆18Feb 5, 2026Updated 6 months ago
- A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.☆36May 11, 2026Updated 3 months ago
- A Comprehensive Speech Processing Algorithms Library for research and production use☆18Oct 25, 2025Updated 9 months ago
- ☆21May 29, 2025Updated last year
- AI agent framework, written from scratch (not based on openclaw), focused on stripping it down to the bare necessities, optimizing token …☆467Updated this week
- Useful Nautilus Scripts made with☆13Jul 27, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A MCP server allowing LLM agents to easily connect and retrieve data from any database☆99Aug 1, 2025Updated last year
- ☆17Oct 27, 2025Updated 9 months ago
- A local-first web search agent☆29Jun 20, 2026Updated last month
- llama.cpp fork with additional SOTA quants and improved performance☆3,056Updated this week
- MAESTRO is an AI-powered research application designed to streamline complex research tasks.☆1,494Apr 16, 2026Updated 4 months ago
- ACE-Step: A Step Towards Music Generation Foundation Model☆50May 20, 2025Updated last year
- A Streamlit app for generating high-quality Q&A training datasets from text and PDFs, leveraging Gemini, Claude, and OpenAI for LLM fine-…☆41Jul 5, 2025Updated last year
- A TTS model capable of generating ultra-realistic dialogue in one pass.☆32May 1, 2025Updated last year
- StatelessChatUI is a lightweight, single-file, OpenAI-compatible chat frontend. It’s built to be portable and privacy-friendly: no accoun…☆19Dec 18, 2025Updated 8 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A markdown web renderer for AI agents — see the web without screenshots☆67May 21, 2026Updated 2 months ago
- Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends☆60Aug 21, 2025Updated 11 months ago
- RelateLang (former RelateScript) is a declarative meta-language designed to streamline the creation of structured and consistent prompts …☆10Mar 19, 2026Updated 5 months ago
- MCP that combats tools overload☆23Aug 9, 2025Updated last year
- A local-first, privacy-preserving alternative to Google NotebookLM — Tauri 2, React 19, Rust, Ollama☆44Jul 30, 2026Updated 2 weeks ago
- ☆16Feb 24, 2025Updated last year
- High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model di…☆281Updated this week