nicholasyager / llama-cpp-guidanceLinks
A guidance compatibility layer for llama-cpp-python
☆36Updated 2 years ago
Alternatives and similar repositories for llama-cpp-guidance
Users that are interested in llama-cpp-guidance are comparing it to the libraries listed below
Sorting:
- Plug n Play GBNF Compiler for llama.cpp☆27Updated last year
- run ollama & gguf easily with a single command☆52Updated last year
- GPT-2 small trained on phi-like data☆67Updated last year
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆45Updated last year
- Complex RAG backend☆29Updated last year
- The one who calls upon functions - Function-Calling Language Model☆36Updated 2 years ago
- ☆32Updated last year
- ☆67Updated last year
- ☆74Updated 2 years ago
- Easily create LLM automation/agent workflows☆59Updated last year
- Let's create synthetic textbooks together :)☆75Updated last year
- One Repo To Quickly Build One Docker File for HuggingChat Front and BackEnd☆26Updated 2 years ago
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆146Updated last year
- ☆116Updated 9 months ago
- ☆38Updated last year
- A simple experiment on letting two local LLM have a conversation about anything!☆112Updated last year
- ☆49Updated last year
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.☆40Updated last year
- An OpenAI-like LLaMA inference API☆113Updated 2 years ago
- Client-side toolkit for using large language models, including where self-hosted☆113Updated 10 months ago
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆76Updated 2 years ago
- Simple Graph Memory for AI applications☆90Updated 4 months ago
- Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).☆102Updated 11 months ago
- A fast batching API to serve LLM models☆187Updated last year
- An OpenAI API compatible LLM inference server based on ExLlamaV2.☆25Updated last year
- autologic is a Python package that implements the SELF-DISCOVER framework proposed in the paper SELF-DISCOVER: Large Language Models Self…☆60Updated last year
- large language model for mastering data analysis using pandas☆47Updated last year
- Easily view and modify JSON datasets for large language models☆83Updated 4 months ago
- ☆16Updated last year
- ☆162Updated last month