Maximilian-Winter / llama-cpp-agentLinks
The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.
☆579Updated 5 months ago
Alternatives and similar repositories for llama-cpp-agent
Users that are interested in llama-cpp-agent are comparing it to the libraries listed below
Sorting:
- function calling-based LLM agents☆287Updated 10 months ago
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆603Updated 9 months ago
- A fast batching API to serve LLM models☆185Updated last year
- A multimodal, function calling powered LLM webui.☆215Updated 10 months ago
- ☆1,022Updated 10 months ago
- The RunPod worker template for serving our large language model endpoints. Powered by vLLM.☆337Updated this week
- 🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.☆388Updated 2 months ago
- Convenience scripts to finetune (chat-)LLaMa3 and other models for any language☆310Updated last year
- Large-scale LLM inference engine☆1,492Updated this week
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆184Updated last year
- Web UI for ExLlamaV2☆506Updated 5 months ago
- Efficient visual programming for AI language models☆364Updated 2 months ago
- An AI assistant beyond the chat box.☆328Updated last year
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆158Updated last year
- ☆204Updated last week
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆259Updated 4 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆222Updated last year
- A python package for developing AI applications with local LLMs.☆151Updated 6 months ago
- A tool for generating function arguments and choosing what function to call with local LLMs☆427Updated last year
- Self-evaluating interview for AI coders☆590Updated last month
- A library for easily merging multiple LLM experts, and efficiently train the merged LLM.☆489Updated 11 months ago
- Software to implement GoT with a weviate vectorized database☆674Updated 4 months ago
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆319Updated 5 months ago
- Task-based Agentic Framework using StrictJSON as the core☆455Updated 2 weeks ago
- This is our own implementation of 'Layer Selective Rank Reduction'☆239Updated last year
- The easiest, and fastest way to run AI-generated Python code safely☆329Updated 8 months ago
- An AI memory layer with short- and long-term storage, semantic clustering, and optional memory decay for context-aware applications.☆651Updated 6 months ago
- SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.☆275Updated last month
- Customizable implementation of the self-instruct paper.☆1,048Updated last year
- Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive…☆683Updated 11 months ago