adrienbrault / json-schema-to-gbnfLinks
Converts JSON-Schema to GBNF grammar to use with llama.cpp
☆55Updated last year
Alternatives and similar repositories for json-schema-to-gbnf
Users that are interested in json-schema-to-gbnf are comparing it to the libraries listed below
Sorting:
- Generates grammer files from typescript for LLM generation☆38Updated last year
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆137Updated 11 months ago
- A library for incremental loading of large PyTorch checkpoints☆56Updated 2 years ago
- Plug n Play GBNF Compiler for llama.cpp☆25Updated last year
- ☆30Updated last year
- GPU accelerated client-side embeddings for vector search, RAG etc.☆66Updated last year
- ☆40Updated 2 years ago
- Embedding models from Jina AI☆60Updated last year
- A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.☆47Updated 10 months ago
- Command-line script for inferencing from models such as falcon-7b-instruct☆75Updated 2 years ago
- ☆35Updated 2 years ago
- Local Startup Advisor Chatbot☆31Updated last year
- hnsqlite integrates hnswlib and sqlite for simple text embedding search☆160Updated last year
- A library for working with GBNF files☆23Updated 3 weeks ago
- Some tough questions to test new models.☆28Updated last year
- LLM plugin for clustering embeddings☆76Updated last year
- WebGPU LLM inference tuned by hand☆151Updated 2 years ago
- utilities for loading and running text embeddings with onnx☆44Updated 10 months ago
- Extend the original llama.cpp repo to support redpajama model.☆118Updated 9 months ago
- ☆55Updated 2 years ago
- ☆31Updated last year
- Drop in replacement for OpenAI, but with Open models.☆152Updated 2 years ago
- A web-app to explore topics using LLM (less typing and more clicks)☆68Updated last year
- ☆22Updated last year
- ☆28Updated last year
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆75Updated last year
- Command line tool for Deep Infra cloud ML inference service☆31Updated last year
- LLM plugin providing access to Mistral models using the Mistral API☆183Updated 3 weeks ago
- codellama on CPU without Docker☆25Updated last year
- Simple LLM inference server☆20Updated last year