nicholasyager / llama-cpp-guidanceLinks
A guidance compatibility layer for llama-cpp-python
☆36Updated 2 years ago
Alternatives and similar repositories for llama-cpp-guidance
Users that are interested in llama-cpp-guidance are comparing it to the libraries listed below
Sorting:
- Plug n Play GBNF Compiler for llama.cpp☆28Updated 2 years ago
- Complex RAG backend☆29Updated last year
- ☆38Updated last year
- ☆31Updated last year
- A high performance batching router optimises max throughput for text inference workload☆16Updated 2 years ago
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.☆42Updated last year
- The one who calls upon functions - Function-Calling Language Model☆36Updated 2 years ago
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆45Updated last year
- Let's create synthetic textbooks together :)☆75Updated last year
- GPT-2 small trained on phi-like data☆67Updated last year
- Client-side toolkit for using large language models, including where self-hosted☆112Updated last week
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆91Updated 2 months ago
- One Repo To Quickly Build One Docker File for HuggingChat Front and BackEnd☆26Updated 2 years ago
- ☆116Updated 10 months ago
- Roy: A lightweight, model-agnostic framework for crafting advanced multi-agent systems using large language models.☆79Updated 2 years ago
- A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.☆45Updated last year
- ☆67Updated last year
- Easily view and modify JSON datasets for large language models☆83Updated 5 months ago
- A simple experiment on letting two local LLM have a conversation about anything!☆111Updated last year
- run ollama & gguf easily with a single command☆52Updated last year
- auto fine tune of models with synthetic data☆75Updated last year
- Generate Structured JSON with probs from Language Models☆17Updated 7 months ago
- A Python library to orchestrate LLMs in a neural network-inspired structure☆51Updated last year
- Easily create LLM automation/agent workflows☆61Updated last year
- Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).☆102Updated last year
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆145Updated last month
- ☆17Updated 10 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆71Updated last week
- ☆49Updated last year
- Local LLM inference & management server with built-in OpenAI API☆31Updated last year