richardanaya / gbnfLinks
A library for working with GBNF files
☆26Updated 3 weeks ago
Alternatives and similar repositories for gbnf
Users that are interested in gbnf are comparing it to the libraries listed below
Sorting:
- Using langchain, deeplake and openai to create a Q&A on the Mojo lang programming manual☆22Updated last year
- Light WebUI for lm.rs☆24Updated last year
- ☆16Updated last year
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆25Updated last year
- Extract structured data from local or remote LLM models☆49Updated last year
- Run AI models anywhere. https://muna.ai/explore☆69Updated this week
- ☆31Updated last year
- LLM plugin for clustering embeddings☆82Updated last year
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆62Updated 2 years ago
- A web-app to explore topics using LLM (less typing and more clicks)☆67Updated last year
- Easily create LLM automation/agent workflows☆60Updated last year
- Local LLM inference & management server with built-in OpenAI API☆31Updated last year
- ☆10Updated 2 years ago
- A guidance compatibility layer for llama-cpp-python☆36Updated 2 years ago
- Generate visual podcasts about novels using open source models☆25Updated 2 years ago
- Converts JSON-Schema to GBNF grammar to use with llama.cpp☆55Updated last year
- Unleash the power of FOSS language models on your local machine☆32Updated 2 years ago
- ☆49Updated last year
- A daemon that makes a desktop OS accessible to AI agents☆36Updated 5 months ago
- A high performance batching router optimises max throughput for text inference workload☆16Updated 2 years ago
- powerful and fast tool calling agents☆66Updated 8 months ago
- Embedding models from Jina AI☆65Updated last year
- Plug n Play GBNF Compiler for llama.cpp☆28Updated 2 years ago
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆42Updated last year
- A modular framework for building massively parallel agentic systems☆29Updated 2 months ago
- GPU accelerated client-side embeddings for vector search, RAG etc.☆65Updated last year
- A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.☆50Updated last year
- utilities for loading and running text embeddings with onnx☆44Updated 3 months ago
- ☆59Updated 7 months ago
- Simple LLM inference server☆20Updated last year