nova-land / gbnf-compilerLinks
Plug n Play GBNF Compiler for llama.cpp
☆28Updated 2 years ago
Alternatives and similar repositories for gbnf-compiler
Users that are interested in gbnf-compiler are comparing it to the libraries listed below
Sorting:
- A guidance compatibility layer for llama-cpp-python☆36Updated 2 years ago
- ☆32Updated 2 years ago
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆47Updated last year
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆76Updated 2 years ago
- Experimental LLM Inference UX to aid in creative writing☆127Updated last year
- Client-side toolkit for using large language models, including where self-hosted☆113Updated 2 weeks ago
- Simple Graph Memory for AI applications☆89Updated 7 months ago
- Let's create synthetic textbooks together :)☆75Updated last year
- An AI agent library using Python as the common language to define executable actions and tool interfaces.☆116Updated this week
- Python console application designed to provide an engaging and visually appealing LLM chat experience on Unix-like consoles or Terminals.☆24Updated last month
- ☆68Updated last year
- A Python library to orchestrate LLMs in a neural network-inspired structure☆52Updated last year
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆86Updated last year
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.☆43Updated last year
- GPT-2 small trained on phi-like data☆67Updated last year
- A pythonic library providing light-weighted interface with LLMs☆131Updated 7 months ago
- ⚡️🧪 Fast LLM Tool Calling Experimentation, big and smol☆155Updated last year
- Generates grammer files from typescript for LLM generation☆38Updated last year
- Run AI models anywhere. https://muna.ai/explore☆74Updated last week
- A web-app to explore topics using LLM (less typing and more clicks)☆67Updated last year
- Who needs o1 anyways. Add CoT to any OpenAI compatible endpoint.☆44Updated last year
- Low-Rank adapter extraction for fine-tuned transformers models☆180Updated last year
- ☆54Updated 2 years ago
- Python examples using the bigcode/tiny_starcoder_py 159M model to generate code☆45Updated 2 years ago
- LLM plugin for clustering embeddings☆82Updated last year
- An OpenAI Completions API compatible server for NLP transformers models☆66Updated 2 years ago
- The one who calls upon functions - Function-Calling Language Model☆36Updated 2 years ago
- Chat Markup Language conversation library☆55Updated 2 years ago
- Experimental sampler to make LLMs more creative☆31Updated 2 years ago
- ☆165Updated 4 months ago