nova-land / gbnf-compilerLinks
Plug n Play GBNF Compiler for llama.cpp
β27Updated last year
Alternatives and similar repositories for gbnf-compiler
Users that are interested in gbnf-compiler are comparing it to the libraries listed below
Sorting:
- A guidance compatibility layer for llama-cpp-pythonβ36Updated 2 years ago
- Unofficial python bindings for the rust llm library. πβ€οΈπ¦β75Updated 2 years ago
- GPT-2 small trained on phi-like dataβ67Updated last year
- Experimental LLM Inference UX to aid in creative writingβ121Updated 9 months ago
- β32Updated last year
- Let's create synthetic textbooks together :)β75Updated last year
- A pythonic library providing light-weighted interface with LLMsβ129Updated 3 months ago
- Generates grammer files from typescript for LLM generationβ38Updated last year
- PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-tβ¦β30Updated last year
- Client-side toolkit for using large language models, including where self-hostedβ113Updated 9 months ago
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async APIβ45Updated 11 months ago
- Experimental sampler to make LLMs more creativeβ31Updated 2 years ago
- GRDN.AI app for garden optimizationβ70Updated last year
- The one who calls upon functions - Function-Calling Language Modelβ36Updated last year
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfacesβ139Updated last year
- large language model for mastering data analysis using pandasβ47Updated last year
- β38Updated last year
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing β‘β67Updated 10 months ago
- Generate visual podcasts about novels using open source modelsβ25Updated 2 years ago
- An OpenAI Completions API compatible server for NLP transformers modelsβ65Updated last year
- Python examples using the bigcode/tiny_starcoder_py 159M model to generate codeβ45Updated 2 years ago
- β161Updated last month
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafteβ¦β78Updated 10 months ago
- β74Updated 2 years ago
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.β95Updated 2 months ago
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.β39Updated last year
- Chat Markup Language conversation libraryβ55Updated last year
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applicationsβ28Updated last year
- β67Updated last year
- Simple Graph Memory for AI applicationsβ90Updated 4 months ago