nova-land / gbnf-compilerLinks
Plug n Play GBNF Compiler for llama.cpp
☆27Updated last year
Alternatives and similar repositories for gbnf-compiler
Users that are interested in gbnf-compiler are comparing it to the libraries listed below
Sorting:
- A guidance compatibility layer for llama-cpp-python☆36Updated last year
- ☆32Updated last year
- Experimental LLM Inference UX to aid in creative writing☆120Updated 8 months ago
- GPT-2 small trained on phi-like data☆67Updated last year
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆75Updated 2 years ago
- Client-side toolkit for using large language models, including where self-hosted☆113Updated 9 months ago
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.☆37Updated last year
- A Python library to orchestrate LLMs in a neural network-inspired structure☆51Updated 10 months ago
- Experimental sampler to make LLMs more creative☆31Updated 2 years ago
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆80Updated 11 months ago
- "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"☆48Updated 10 months ago
- ☆66Updated last year
- ☆17Updated 8 months ago
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆145Updated 2 months ago
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆43Updated last year
- Simple Graph Memory for AI applications☆89Updated 3 months ago
- An OpenAI API compatible LLM inference server based on ExLlamaV2.☆25Updated last year
- A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.☆45Updated last year
- Let's create synthetic textbooks together :)☆75Updated last year
- Simple LLM inference server☆20Updated last year
- ☆55Updated 2 years ago
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆45Updated 11 months ago
- ☆49Updated last year
- entropix style sampling + GUI☆27Updated 9 months ago
- ☆132Updated 3 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆146Updated 6 months ago
- GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool-calling in Python. For mor…☆129Updated 3 months ago
- ☆38Updated last year
- Low-Rank adapter extraction for fine-tuned transformers models☆175Updated last year
- A pythonic library providing light-weighted interface with LLMs☆128Updated 3 months ago