dottxt-ai / outlines-coreLinks
Faster structured generation
☆238Updated 2 months ago
Alternatives and similar repositories for outlines-core
Users that are interested in outlines-core are comparing it to the libraries listed below
Sorting:
- Super-fast Structured Outputs☆350Updated this week
- A high-performance constrained decoding engine based on context free grammar in Rust☆54Updated 2 months ago
- High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…☆192Updated 2 weeks ago
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆142Updated 3 weeks ago
- ☆130Updated last year
- Inference engine for GLiNER models, in Rust☆64Updated last month
- This repository has code for fine-tuning LLMs with GRPO specifically for Rust Programming using cargo as feedback☆100Updated 4 months ago
- TensorRT-LLM server with Structured Outputs (JSON) built with Rust☆57Updated 3 months ago
- High-Performance Engine for Multi-Vector Search☆132Updated last month
- ☆154Updated 8 months ago
- Formatron empowers everyone to control the format of language models' output with minimal overhead.☆220Updated last month
- Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…☆186Updated 11 months ago
- ☆199Updated last year
- ☆58Updated 2 years ago
- Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from R…☆461Updated this week
- ☆138Updated last year
- Fast parallel LLM inference for MLX☆204Updated last year
- Late Interaction Models Training & Retrieval☆521Updated 2 weeks ago
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆409Updated this week
- Manage scalable open LLM inference endpoints in Slurm clusters☆268Updated last year
- A framework for optimizing DSPy programs with RL☆94Updated last week
- ☆51Updated last month
- smol models are fun too☆92Updated 8 months ago
- Use context-free grammars with an LLM☆170Updated last year
- A Lightweight Library for AI Observability☆249Updated 5 months ago
- Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.☆273Updated last week
- Train your own SOTA deductive reasoning model☆103Updated 4 months ago
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆75Updated last year
- XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.☆152Updated 3 months ago
- Inference-time scaling for LLMs-as-a-judge.☆267Updated 3 weeks ago