The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.
☆665Mar 9, 2026Updated 8 months ago
Alternatives and similar repositories for llama-cpp-agent
Users that are interested in llama-cpp-agent are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ToolAgents is a lightweight and flexible framework for creating function-calling agents with various language models and APIs.☆39Sep 17, 2026Updated 2 months ago
- ☆32Dec 29, 2023Updated 2 years ago
- Locally running LLM with internet access☆97Jul 23, 2026Updated 3 months ago
- Python bindings for llama.cpp☆10,689Updated this week
- function calling-based LLM agents☆293Sep 16, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Chat language model that can use tools and interpret the results☆1,591Jun 30, 2026Updated 4 months ago
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆146Jul 9, 2024Updated 2 years ago
- A Comprehensive survey on business use cases of AI that help them thrive in the digital economy☆12Oct 7, 2020Updated 6 years ago
- This GUI aims to simplify the process of converting GGUF files to llamafile format by providing an intuitive and convenient way for users…☆14Jan 2, 2026Updated 10 months ago
- Inference of Mamba, Mamba2 and Mamba3 models in pure C☆203Mar 18, 2026Updated 8 months ago
- ☆11Apr 24, 2023Updated 3 years ago
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆351Feb 28, 2025Updated last year
- An experimental desktop client for using Claude Desktop's MCP with Novelcrafter codices.☆11Dec 3, 2024Updated last year
- Simple agent framework using Ollama tool calling☆10Aug 27, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆10Feb 6, 2025Updated last year
- cli tool to quantize gguf, gptq, awq, hqq and exl2 models☆77Dec 17, 2024Updated last year
- Harness LLMs with Multi-Agent Programming☆4,153Updated this week
- A guidance compatibility layer for llama-cpp-python☆37Sep 11, 2023Updated 3 years ago
- A multimodal, function calling powered LLM webui.☆213Sep 23, 2024Updated 2 years ago
- Create Custom LLMs☆1,877Jun 27, 2026Updated 4 months ago
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,888Jan 28, 2024Updated 2 years ago
- Enforce the output format (JSON Schema, Regex etc) of a language model☆2,042Apr 4, 2026Updated 7 months ago
- ☆39Mar 12, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- An AI assistant beyond the chat box.☆324Mar 11, 2024Updated 2 years ago
- An API for VoiceCraft.☆25Jun 27, 2024Updated 2 years ago
- Efficient visual programming for AI language models☆358May 13, 2025Updated last year
- ☆137Jun 30, 2026Updated 4 months ago
- Tools for merging pretrained large language models.☆7,475Oct 31, 2026Updated 2 weeks ago
- A tool for generating function arguments and choosing what function to call with local LLMs☆438Mar 12, 2024Updated 2 years ago
- ☆19Jun 5, 2023Updated 3 years ago
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,654Mar 4, 2026Updated 8 months ago
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16May 8, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- This project is a Streamlit application that automatically summarizes YouTube videos by converting their audio to text and then generatin…☆12Sep 16, 2023Updated 3 years ago
- A frontend for creative writing with LLMs☆175Jul 15, 2024Updated 2 years ago
- Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)☆943Updated this week
- ☆1,506Dec 22, 2025Updated 10 months ago
- ☆360Mar 5, 2026Updated 8 months ago
- Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d,…☆1,693Nov 11, 2026Updated last week
- 本项目主要对开源的MOSS SFT数据进行整理 ,转换成mnbvc多轮对话格式。MOSS-003涵盖用性、忠实性、无害性三个层面,共353w样本,MOSS-003 包含更细粒度的有用性类别标记、更广泛的无害性数据和更长对话轮数,共630w样本,☆13Dec 3, 2023Updated 2 years ago
Are these results useful?