The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.
☆661Mar 9, 2026Updated 7 months ago
Alternatives and similar repositories for llama-cpp-agent
Users that are interested in llama-cpp-agent are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ToolAgents is a lightweight and flexible framework for creating function-calling agents with various language models and APIs.☆39Sep 17, 2026Updated last month
- ☆32Dec 29, 2023Updated 2 years ago
- Locally running LLM with internet access☆96Jul 23, 2026Updated 3 months ago
- Python bindings for llama.cpp☆10,666Oct 1, 2026Updated 3 weeks ago
- function calling-based LLM agents☆292Sep 16, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Chat language model that can use tools and interpret the results☆1,593Jun 30, 2026Updated 3 months ago
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆146Jul 9, 2024Updated 2 years ago
- This GUI aims to simplify the process of converting GGUF files to llamafile format by providing an intuitive and convenient way for users…☆14Jan 2, 2026Updated 9 months ago
- A Comprehensive survey on business use cases of AI that help them thrive in the digital economy☆12Oct 7, 2020Updated 6 years ago
- Inference of Mamba, Mamba2 and Mamba3 models in pure C☆203Mar 18, 2026Updated 7 months ago
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆350Feb 28, 2025Updated last year
- ☆11Apr 24, 2023Updated 3 years ago
- Harness LLMs with Multi-Agent Programming☆4,122Updated this week
- Simple agent framework using Ollama tool calling☆10Aug 27, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- An experimental desktop client for using Claude Desktop's MCP with Novelcrafter codices.☆11Dec 3, 2024Updated last year
- A guidance compatibility layer for llama-cpp-python☆37Sep 11, 2023Updated 3 years ago
- Create Custom LLMs☆1,870Jun 27, 2026Updated 4 months ago
- ☆10Feb 6, 2025Updated last year
- cli tool to quantize gguf, gptq, awq, hqq and exl2 models☆77Dec 17, 2024Updated last year
- A multimodal, function calling powered LLM webui.☆212Sep 23, 2024Updated 2 years ago
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,886Jan 28, 2024Updated 2 years ago
- Enforce the output format (JSON Schema, Regex etc) of a language model☆2,037Apr 4, 2026Updated 6 months ago
- Tools for merging pretrained large language models.☆7,421Oct 22, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 本项目主要对开源的MOSS SFT数据进行整理 ，转换成mnbvc多轮对话格式。MOSS-003涵盖用性、忠实性、无害性三个层面，共353w样本，MOSS-003 包含更细粒度的有用性类别标记、更广泛的无害性数据和更长对话轮数，共630w样本，☆13Dec 3, 2023Updated 2 years ago
- An AI assistant beyond the chat box.☆325Mar 11, 2024Updated 2 years ago
- ☆38Mar 12, 2024Updated 2 years ago
- Efficient visual programming for AI language models☆357May 13, 2025Updated last year
- ☆137Jun 30, 2026Updated 3 months ago
- An API for VoiceCraft.☆25Jun 27, 2024Updated 2 years ago
- ☆19Jun 5, 2023Updated 3 years ago
- A tool for generating function arguments and choosing what function to call with local LLMs☆437Mar 12, 2024Updated 2 years ago
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,646Mar 4, 2026Updated 7 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …☆39Jun 12, 2024Updated 2 years ago
- ☆1,490Dec 22, 2025Updated 10 months ago
- A frontend for creative writing with LLMs☆172Jul 15, 2024Updated 2 years ago
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16May 8, 2025Updated last year
- This project is a Streamlit application that automatically summarizes YouTube videos by converting their audio to text and then generatin…☆12Sep 16, 2023Updated 3 years ago
- Converts JSON-Schema to GBNF grammar to use with llama.cpp☆56Nov 27, 2023Updated 2 years ago
- ☆359Mar 5, 2026Updated 7 months ago