nicholasyager / llama-cpp-guidanceLinks
A guidance compatibility layer for llama-cpp-python
☆36Updated 2 years ago
Alternatives and similar repositories for llama-cpp-guidance
Users that are interested in llama-cpp-guidance are comparing it to the libraries listed below
Sorting:
- Plug n Play GBNF Compiler for llama.cpp☆27Updated last year
- ☆38Updated last year
- GPT-2 small trained on phi-like data☆67Updated last year
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆45Updated 11 months ago
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆90Updated this week
- Chat Markup Language conversation library☆55Updated last year
- ☆116Updated 8 months ago
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆75Updated 2 years ago
- entropix style sampling + GUI☆27Updated 10 months ago
- Complex RAG backend☆29Updated last year
- Client-side toolkit for using large language models, including where self-hosted☆113Updated 9 months ago
- ☆67Updated last year
- ☆161Updated last month
- A Python library to orchestrate LLMs in a neural network-inspired structure☆50Updated 11 months ago
- Easily view and modify JSON datasets for large language models☆82Updated 3 months ago
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆92Updated 7 months ago
- Let's create synthetic textbooks together :)☆75Updated last year
- The one who calls upon functions - Function-Calling Language Model☆36Updated last year
- run ollama & gguf easily with a single command☆52Updated last year
- Simple Graph Memory for AI applications☆90Updated 3 months ago
- ☆32Updated last year
- ☆74Updated 2 years ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated last year
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.☆37Updated last year
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆222Updated last year
- A simple experiment on letting two local LLM have a conversation about anything!☆111Updated last year
- An OpenAI API compatible LLM inference server based on ExLlamaV2.☆25Updated last year
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆145Updated last year
- A framework for evaluating function calls made by LLMs☆38Updated last year
- ☆132Updated 4 months ago