Dan-wanna-M / kbnf
A high-performance constrained decoding engine based on context free grammar in Rust
☆46Updated last month
Alternatives and similar repositories for kbnf:
Users that are interested in kbnf are comparing it to the libraries listed below
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆37Updated last year
- ☆19Updated 4 months ago
- implement llava using candle☆14Updated 8 months ago
- ☆28Updated 3 months ago
- ☆57Updated last year
- Experimental compiler for deep learning models☆26Updated this week
- Super-fast Structured Outputs☆114Updated this week
- Faster structured generation☆177Updated this week
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆32Updated 9 months ago
- Low rank adaptation (LoRA) for Candle.☆142Updated 6 months ago
- Modular Rust transformer/LLM library using Candle☆36Updated 9 months ago
- Automatically derive Python dunder methods for your Rust code☆14Updated 6 months ago
- Locality Sensitive Hashing☆70Updated last year
- A collection of optimisers for use with candle☆34Updated 3 months ago
- ☆12Updated last year
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆306Updated this week
- ☆125Updated 9 months ago
- Implementing the BitNet model in Rust☆30Updated 10 months ago
- High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…☆77Updated this week
- 8-bit floating point types for Rust☆44Updated 3 weeks ago
- Fast serverless LLM inference, in Rust.☆60Updated last month
- ☆21Updated 7 months ago
- ☆37Updated 2 years ago
- Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.☆73Updated last year
- A text embedding extension for the Polars Dataframe library.☆23Updated 3 months ago
- Port of Andrej Karpathy's minbpe to Rust☆20Updated 9 months ago
- Structured outputs for LLMs☆37Updated 7 months ago
- A Keras like abstraction layer on top of the Rust ML framework candle☆23Updated 8 months ago
- Extract core logic from qdrant and make it available as a library.☆57Updated 10 months ago
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆38Updated 11 months ago