A high-performance constrained decoding engine based on context free grammar in Rust
☆58May 22, 2025Updated 9 months ago
Alternatives and similar repositories for kbnf
Users that are interested in kbnf are comparing it to the libraries listed below
Sorting:
- Formatron empowers everyone to control the format of language models' output with minimal overhead.☆234Jun 7, 2025Updated 9 months ago
- Fast serverless LLM inference, in Rust.☆110Nov 5, 2025Updated 4 months ago
- Low rank adaptation (LoRA) for Candle.☆169Apr 18, 2025Updated 10 months ago
- ☆19Dec 31, 2025Updated 2 months ago
- A Keras like abstraction layer on top of the Rust ML framework candle☆23Jun 16, 2024Updated last year
- Super-fast Structured Outputs☆706Updated this week
- Find out why your CoreML model isn't running on the Neural Engine!☆30Jun 18, 2024Updated last year
- Claude Code for Kimi K2☆14Sep 15, 2025Updated 5 months ago
- A notebook interface that makes working with AI agents easier.☆15Jul 12, 2025Updated 7 months ago
- ☆12Jan 4, 2024Updated 2 years ago
- ☆11Jul 23, 2023Updated 2 years ago
- Structured Generation Evals☆14Sep 25, 2024Updated last year
- Rust snippets and tips☆17Oct 20, 2021Updated 4 years ago
- Code for my workshop "Production-ready WebAssembly with Rust" presented at RustLab 2023 in Florence☆15Nov 23, 2023Updated 2 years ago
- RPC for Rust☆16Nov 30, 2023Updated 2 years ago
- CEL evaluator written in Rust☆17Feb 25, 2026Updated last week
- a bot using an OODA loop...☆25Jan 19, 2026Updated last month
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆47May 3, 2024Updated last year
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆244Aug 6, 2025Updated 7 months ago
- A complete(grpc service and lib) Rust inference with multilingual embedding support. This version leverages the power of Rust for both GR…☆40Aug 20, 2024Updated last year
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆607Updated this week
- Automatically derive Python dunder methods for your Rust code☆25Jan 28, 2026Updated last month
- Candle Pipelines provides a simple, intuitive interface for Rust developers who want to work with Large Language Models locally, powered …☆23Jan 5, 2026Updated 2 months ago
- Minimalist ML framework for Rust☆21Feb 28, 2026Updated last week
- Robust data transformation tool using SQL☆22Dec 20, 2022Updated 3 years ago
- 8-bit floating point types for Rust☆63Feb 4, 2026Updated last month
- A tool for generating geometric figures based on definitions and rules.☆20Dec 11, 2024Updated last year
- Experimental ONNX implementation for WASI NN.☆48Nov 15, 2021Updated 4 years ago
- Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.☆29Oct 18, 2024Updated last year
- Rust SDK for Numaflow☆24Updated this week
- ☆30Dec 15, 2023Updated 2 years ago
- webtransport full stack dev kit for rustaceans☆30Oct 31, 2024Updated last year
- A calendar for CLI nerds☆25Mar 8, 2024Updated 2 years ago
- Fast and versatile tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and…☆45Oct 10, 2025Updated 4 months ago
- Mechanisms for high-performance hardware-aware programming in Rust☆33Feb 28, 2026Updated last week
- Reforms is a fresh pydantic-based forms validation and rendering library for Python 3.6+.☆25Feb 16, 2024Updated 2 years ago
- Democratizing large model inference and training on any device.☆208Mar 2, 2026Updated last week
- [DoNotUse] OpenTelemetry Collector with Apache Arrow support FORK OF OPENTELEMETRY COLLECTOR☆31Sep 12, 2023Updated 2 years ago
- Experimental compiler for deep learning models☆75Sep 18, 2025Updated 5 months ago