Lightweight Python tool using Optuna for tuning llama.cpp flags: towards optimal tok/s for your machine
☆60Aug 17, 2026Updated 2 months ago
Alternatives and similar repositories for llama-optimus
Users that are interested in llama-optimus are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A beautifully crafted desktop client for running and managing local LLMs via llama.cpp.☆23May 25, 2026Updated 5 months ago
- P2P semantic matching for on-device AI agents. No server, no cloud.☆20Jun 12, 2026Updated 5 months ago
- ☆11May 29, 2026Updated 5 months ago
- Pure C wrapper library to use llama.cpp with Linux and Windows as simple as possible.☆16Sep 6, 2026Updated 2 months ago
- MCP-powered memory, policy, and experience layer for safer AI agents.☆12May 8, 2026Updated 6 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Shrink the web for your agents! Token-efficient, fast and fully local web search and research.☆236Updated this week
- Strix Halo inference engine. Qwen Flash Next Q4_K_XL: 1,628.52pp, 59.41tg single user, 157.22 tok/s 8 users; Qwen27B Q4_K_XL: 656.33pp, 7…☆40Nov 2, 2026Updated last week
- WHIRL (Windows HIP Inference for RDNA LLMs): native Windows C++/HIP LLM inference engine for the AMD Ryzen AI Max+ 395 (Radeon 8060S) and…☆39Updated this week
- Thinking blocks that open during generation: a gate decides when to think, a tree of candidate thoughts is explored, and the best one sta…☆18Oct 11, 2026Updated last month
- A modular llama.cpp integration for ComfyUI - local LLM inference nodes☆13Oct 22, 2026Updated 3 weeks ago
- An MCP server for dataset generation, fine-tuning, RL, and evaluation of LLMs — directly from your coding agent.☆17Apr 21, 2026Updated 6 months ago
- ☆11Sep 28, 2026Updated last month
- It lets an AI agent put a live, interactive page on any screen you own, and brings what you do on it back into the conversation.☆29Updated this week
- Turn documents into high-quality instruction datasets with grounding, quality filtering, deduplication, and provenance.☆32Apr 23, 2026Updated 6 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A free, open-source AI agent that runs entirely on your machine — controls your computer like you would, works across any app, and handle…☆100Updated this week
- A Pinokio installer for Ostris' ai-toolkit, The ultimate training toolkit for finetuning diffusion models. Main branch is [NVIDIA ONLY]☆15Oct 4, 2026Updated last month
- ToolAgents is a lightweight and flexible framework for creating function-calling agents with various language models and APIs.☆39Sep 17, 2026Updated last month
- Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, …☆37Oct 25, 2026Updated 2 weeks ago
- The all-in-one AI assistant for development and content creation☆16Aug 12, 2026Updated 3 months ago
- Private-first, self-hostable knowledge base. Your data, your server, your control. No cloud, no telemetry, no trust required.☆22Oct 4, 2026Updated last month
- Simple Tool Caller for llama.cpp☆11Aug 12, 2024Updated 2 years ago
- Simple and powerful extension for searching web and viewing website content.☆14Apr 11, 2025Updated last year
- ☆23Sep 10, 2026Updated 2 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- RouteWeaver: experimental cache-safe speculative inference and CPU/GPU transfer optimization for Qwen 27B on low-VRAM NVIDIA GPUs.☆35Oct 10, 2026Updated last month
- Bare-metal microVM execution engine in Rust. Sub-5ms snapshot restores, Zero-NIC network isolation, and 30 built-in language toolchains f…☆22Sep 6, 2026Updated 2 months ago
- A custom LLM runtime for the Sony PSP, running a 90M parameter language model locally.☆27Oct 10, 2026Updated last month
- Native Windows ports of Rampage: World Tour and Rampage 2: Universal Tour (N64), statically recompiled with N64Recomp. Bring your own ROM…☆14Nov 3, 2026Updated last week
- Deterministic PyGhidra extraction, triage, and local LLM compiler-backend pipeline for C reimplementation.☆11Oct 18, 2026Updated 3 weeks ago
- CAD files for the Vertex Delta☆11Jan 2, 2019Updated 7 years ago
- A NPC AI Framework , based on character personalities, can be used for game NPC (extendable for Godot / Unity)☆23Sep 21, 2026Updated last month
- Source-only repair utility for one known RenoDX DLSS Neural Rendering STANDBY/FAILED signature error. No NVIDIA DLLs or downloads include…☆15Aug 28, 2026Updated 2 months ago
- Stable Diffusion in pure C/C++☆18Oct 18, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- LLM inference in C/C++☆43Nov 5, 2026Updated last week
- A simple python-based terminal tool to manage llama.cpp☆13Sep 30, 2025Updated last year
- An all in one AI solution compatible with any known AI service on the planet☆106Updated this week
- Standalone NVIDIA DLSS Frame Interpolation for video files: 24fps video to ->60/72/90/120 fps with real generated intermediate frames, di…☆12Sep 9, 2026Updated 2 months ago
- Tool to statically recompile SNES games into native executables.☆11Jun 6, 2026Updated 5 months ago
- Single-file C++ TTS runtime for Pocket TTS with ONNX Runtime — voice cloning, streaming, HTTP server, FFI C API☆65Mar 29, 2026Updated 7 months ago
- ☆16Sep 25, 2026Updated last month
Are these results useful?