adrienbrault / json-schema-to-gbnfLinks
Converts JSON-Schema to GBNF grammar to use with llama.cpp
☆55Updated 2 years ago
Alternatives and similar repositories for json-schema-to-gbnf
Users that are interested in json-schema-to-gbnf are comparing it to the libraries listed below
Sorting:
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆141Updated last year
- Generates grammer files from typescript for LLM generation☆38Updated last year
- A library for incremental loading of large PyTorch checkpoints☆56Updated 2 years ago
- ☆31Updated 2 years ago
- GPU accelerated client-side embeddings for vector search, RAG etc.☆65Updated 2 years ago
- Extend the original llama.cpp repo to support redpajama model.☆118Updated last year
- Plug n Play GBNF Compiler for llama.cpp☆28Updated 2 years ago
- LLM plugin for clustering embeddings☆82Updated last year
- A library for working with GBNF files☆27Updated 2 months ago
- hnsqlite integrates hnswlib and sqlite for simple text embedding search☆160Updated 2 years ago
- Drop in replacement for OpenAI, but with Open models.☆154Updated 2 years ago
- Local LLaMAs/Models in VSCode☆54Updated 2 years ago
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆76Updated 2 years ago
- Chat Markup Language conversation library☆55Updated 2 years ago
- Use context-free grammars with an LLM☆174Updated last year
- Code repo for "Most Language Models can be Poets too: An AI Writing Assistant and Constrained Text Generation Studio" at the (CAI2) wor…☆213Updated 2 years ago
- ☆114Updated last year
- WebGPU LLM inference tuned by hand☆151Updated 2 years ago
- ☆35Updated 2 years ago
- Replace expensive LLM calls with finetunes automatically☆66Updated last year
- utilities for loading and running text embeddings with onnx☆45Updated 5 months ago
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆109Updated 2 years ago
- Using Large Language Models for Repo-wide Type Prediction☆114Updated 2 years ago
- Embedding models from Jina AI☆65Updated 2 years ago
- GoalChain for goal-orientated LLM conversation flows☆71Updated last year
- Command-line script for inferencing from models such as falcon-7b-instruct☆75Updated 2 years ago
- Experimental LLM Inference UX to aid in creative writing☆127Updated last year
- iterate quickly with llama.cpp hot reloading. use the llama.cpp bindings with bun.sh☆50Updated 2 years ago
- A web-app to explore topics using LLM (less typing and more clicks)☆67Updated 2 years ago
- Command-line script for inferencing from models such as MPT-7B-Chat☆100Updated 2 years ago