nicholasyager / llama-cpp-guidanceLinks
A guidance compatibility layer for llama-cpp-python
☆35Updated last year
Alternatives and similar repositories for llama-cpp-guidance
Users that are interested in llama-cpp-guidance are comparing it to the libraries listed below
Sorting:
- Plug n Play GBNF Compiler for llama.cpp☆26Updated last year
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆45Updated 10 months ago
- Complex RAG backend☆29Updated last year
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆87Updated last month
- Client-side toolkit for using large language models, including where self-hosted☆112Updated 8 months ago
- Easily create LLM automation/agent workflows☆59Updated last year
- ☆38Updated last year
- Roy: A lightweight, model-agnostic framework for crafting advanced multi-agent systems using large language models.☆78Updated last year
- GPT-2 small trained on phi-like data☆67Updated last year
- ☆66Updated last year
- The one who calls upon functions - Function-Calling Language Model☆36Updated last year
- ☆115Updated 7 months ago
- A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.☆45Updated last year
- ☆39Updated last year
- ☆157Updated last year
- large language model for mastering data analysis using pandas☆47Updated last year
- Let's create synthetic textbooks together :)☆75Updated last year
- An OpenAI-like LLaMA inference API☆112Updated last year
- run ollama & gguf easily with a single command☆52Updated last year
- Experimental LLM Inference UX to aid in creative writing☆119Updated 7 months ago
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆146Updated last year
- A simple experiment on letting two local LLM have a conversation about anything!☆110Updated last year
- A fast batching API to serve LLM models☆185Updated last year
- ☆31Updated last year
- autologic is a Python package that implements the SELF-DISCOVER framework proposed in the paper SELF-DISCOVER: Large Language Models Self…☆60Updated last year
- Easily view and modify JSON datasets for large language models☆81Updated 2 months ago
- auto fine tune of models with synthetic data☆76Updated last year
- ☆49Updated last year
- Simple Graph Memory for AI applications☆89Updated 2 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆222Updated last year