The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.
☆659Mar 9, 2026Updated 7 months ago
Alternatives and similar repositories for llama-cpp-agent
Users that are interested in llama-cpp-agent are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ToolAgents is a lightweight and flexible framework for creating function-calling agents with various language models and APIs.☆39Sep 17, 2026Updated 3 weeks ago
- ☆32Dec 29, 2023Updated 2 years ago
- Locally running LLM with internet access☆96Jul 23, 2026Updated 2 months ago
- Python bindings for llama.cpp☆10,642Oct 1, 2026Updated last week
- function calling-based LLM agents☆292Sep 16, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Comprehensive survey on business use cases of AI that help them thrive in the digital economy☆12Oct 7, 2020Updated 6 years ago
- An experimental desktop client for using Claude Desktop's MCP with Novelcrafter codices.☆11Dec 3, 2024Updated last year
- Chat language model that can use tools and interpret the results☆1,595Jun 30, 2026Updated 3 months ago
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆146Jul 9, 2024Updated 2 years ago
- This GUI aims to simplify the process of converting GGUF files to llamafile format by providing an intuitive and convenient way for users…☆14Jan 2, 2026Updated 9 months ago
- Inference of Mamba, Mamba2 and Mamba3 models in pure C☆202Mar 18, 2026Updated 6 months ago
- A guidance compatibility layer for llama-cpp-python☆37Sep 11, 2023Updated 3 years ago
- Harness LLMs with Multi-Agent Programming☆4,113Updated this week
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆352Feb 28, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,886Jan 28, 2024Updated 2 years ago
- Create Custom LLMs☆1,873Jun 27, 2026Updated 3 months ago
- Enforce the output format (JSON Schema, Regex etc) of a language model☆2,041Apr 4, 2026Updated 6 months ago
- A multimodal, function calling powered LLM webui.☆213Sep 23, 2024Updated 2 years ago
- Simple agent framework using Ollama tool calling☆10Aug 27, 2024Updated 2 years ago
- cli tool to quantize gguf, gptq, awq, hqq and exl2 models☆77Dec 17, 2024Updated last year
- ☆357Mar 5, 2026Updated 7 months ago
- Converts JSON-Schema to GBNF grammar to use with llama.cpp☆56Nov 27, 2023Updated 2 years ago
- ☆137Jun 30, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆19Jun 5, 2023Updated 3 years ago
- An AI assistant beyond the chat box.☆325Mar 11, 2024Updated 2 years ago
- A tool for generating function arguments and choosing what function to call with local LLMs☆435Mar 12, 2024Updated 2 years ago
- ☆38Mar 12, 2024Updated 2 years ago
- WilmerAI is one of the oldest LLM semantic routers. It uses multi-layer prompt routing and complex workflows to allow you to not only cre…☆831Updated this week
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆1,459Updated this week
- A library for working with GBNF files☆31May 27, 2026Updated 4 months ago
- A frontend for creative writing with LLMs☆171Jul 15, 2024Updated 2 years ago
- A simple experiment on letting two local LLM have a conversation about anything!☆111Jul 3, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Tools for merging pretrained large language models.☆7,392Sep 12, 2026Updated 3 weeks ago
- ☆1,482Dec 22, 2025Updated 9 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆151Jan 7, 2026Updated 9 months ago
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,632Mar 4, 2026Updated 7 months ago
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16May 8, 2025Updated last year
- Efficient visual programming for AI language models☆357May 13, 2025Updated last year
- Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.☆386Mar 13, 2024Updated 2 years ago