Lightweight Python tool using Optuna for tuning llama.cpp flags: towards optimal tok/s for your machine
☆61Aug 17, 2026Updated 2 months ago
Alternatives and similar repositories for llama-optimus
Users that are interested in llama-optimus are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Rulith Inference, formerly Strix Llama. Serving a 125B MoE model fast on one AMD Strix Halo machine, on Windows: a patched llama.cpp, a m…☆40Updated this week
- A fast diffusion model engine for image generation and editing.☆36Updated this week
- Automating llama.cpp LLM parameter optimization for highest speed/best fit using Morris/Taguchi DoE sweeps.☆93Oct 15, 2026Updated last week
- A beautifully crafted desktop client for running and managing local LLMs via llama.cpp.☆23May 25, 2026Updated 4 months ago
- It lets an AI agent put a live, interactive page on any screen you own, and brings what you do on it back into the conversation.☆18Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Pure C wrapper library to use llama.cpp with Linux and Windows as simple as possible.☆15Sep 6, 2026Updated last month
- Shrink the web for your agents! Token-efficient, fast and fully local web search and research.☆234Updated this week
- Production-ready AI agent examples you can clone and run in 5 minutes.☆35Jul 6, 2026Updated 3 months ago
- Local LLM Server Manager + LlaMA.cpp + Chat☆141Oct 15, 2026Updated last week
- Local-first vault agent in Rust, grammar-enforced tools, markdown as memory readable for human and agent, but in principle is the agent i…☆30Sep 22, 2026Updated last month
- Decentralizing distribution of open-source AI models.☆25Updated this week
- LLM inference in C/C++☆42Updated this week
- Open-source control panel for the real llama.cpp: see where a model lands in your VRAM before loading, every llama-server flag per model,…☆106Updated this week
- A free, open-source AI agent that runs entirely on your machine — controls your computer like you would, works across any app, and handle…☆95Sep 22, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A MIDI library over USB, based on PluggableUSB☆12Nov 5, 2018Updated 7 years ago
- Local, gradient-free neuro-symbolic memory engine combining Hyperdimensional Computing (HDC/VSA), Hebbian plasticity, and graph triples f…☆144Oct 11, 2026Updated last week
- Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, …☆34Oct 1, 2026Updated 3 weeks ago
- The all-in-one AI assistant for development and content creation☆16Aug 12, 2026Updated 2 months ago
- Bare-metal microVM execution engine in Rust. Sub-5ms snapshot restores, Zero-NIC network isolation, and 30 built-in language toolchains f…☆22Sep 6, 2026Updated last month
- Own your LLM's web search: a local search->fetch->rank pipeline that replaces hosted web-search tools. Measured: matches hosted accuracy …☆60Jul 23, 2026Updated 3 months ago
- Profile repo — categorized index of NVFP4 model releases, DGX Spark inference stacks, Apple Silicon MLX builds, the voice-AI stack, and t…☆41Oct 6, 2026Updated 2 weeks ago
- ☆23Sep 10, 2026Updated last month
- A custom LLM runtime for the Sony PSP, running a 90M parameter language model locally.☆27Oct 10, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A bare-bones GUI application for the local inference engine, llama.cpp. Built-in TPE optimiser to find the best flags for your system☆18Oct 15, 2026Updated last week
- Impeccable.style extension for Pi☆15Jun 22, 2026Updated 4 months ago
- Private-first, self-hostable knowledge base. Your data, your server, your control. No cloud, no telemetry, no trust required.☆22Oct 4, 2026Updated 2 weeks ago
- Overkill stuff for BT☆13Jun 23, 2026Updated 4 months ago
- Private voice dictation for Windows, macOS and Linux. Hold a shortcut, talk, and Lipwise types what you meant into any app: speech recogn…☆25Oct 13, 2026Updated last week
- Simple Tool Caller for llama.cpp☆11Aug 12, 2024Updated 2 years ago
- Kotai is a fully local, zero-cost voice assistant that combines the power of Kyutai TTS/STT, LiveKit, and local LLMs to create natural co…☆10Jul 14, 2025Updated last year
- ☆11Jan 22, 2025Updated last year
- Run MoE models bigger than your RAM, without the speed cliff☆17Oct 16, 2026Updated last week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- The Open Source Strix Halo AI engine. Qwen 3.8 Flash Next Q4_K_XL: 1,801.01 pp, 73.17 tg single user, 194.37 tok/s 8 users; Qwen 3.8 27B…☆849Updated this week
- Simple and powerful extension for searching web and viewing website content.☆14Apr 11, 2025Updated last year
- experimental linux kernel modules and userspace drivers for RDMA-over-usb4/thunderbolt on consumer hardware☆71Updated this week
- A free custom ModSecurity ruleset to enhance the Comodo WAF. Adds proactive brute-force, scanner, and behavioral threat protection.☆16Sep 24, 2026Updated 3 weeks ago
- ☆14Oct 12, 2026Updated last week
- High-performance universal media optimizer for images, video, and audio. Built with Nuitka and Go, with auto-GPU acceleration and crash-s…☆20Sep 13, 2026Updated last month
- GPU + XDNA2 NPU inference for AMD Strix Halo (gfx1151): Qwen3.6-35B-A3B, Qwen3.8-27B and Qwen3.8 Flash-Next. NPU prefill +9% to +28%, MTP…☆74Updated this week