aastroza / structured-generation-benchmarkLinks
Structured Generation Evals
☆12Updated 10 months ago
Alternatives and similar repositories for structured-generation-benchmark
Users that are interested in structured-generation-benchmark are comparing it to the libraries listed below
Sorting:
- ☆64Updated last month
- ☆28Updated last month
- minimal pytorch implementation of bm25 (with sparse tensors)☆104Updated last year
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆32Updated 3 months ago
- An introduction to LLM Sampling☆79Updated 7 months ago
- Probabilistic LLM evaluations. [CogSci2023; ACL2023]☆73Updated last year
- Fast, High-Fidelity LLM Decoding with Regex Constraints☆20Updated last year
- Supercharge huggingface transformers with model parallelism.☆77Updated 2 weeks ago
- Extract full next-token probabilities via language model APIs☆247Updated last year
- Crispy reranking models by Mixedbread☆33Updated 3 weeks ago
- Benchmark structured generation libraries☆27Updated 9 months ago
- ☆53Updated 9 months ago
- ☆88Updated 7 months ago
- Train your own SOTA deductive reasoning model☆103Updated 5 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆65Updated last year
- An attribution library for LLMs☆42Updated 10 months ago
- ☆51Updated last month
- ☆37Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 6 months ago
- A domain-specific probabilistic programming language for modeling and inference with language models☆132Updated 3 months ago
- ☆136Updated 4 months ago
- PyTorch implementation for MRL☆19Updated last year
- Functional Benchmarks and the Reasoning Gap☆88Updated 10 months ago
- ReLM is a Regular Expression engine for Language Models☆106Updated 2 years ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆140Updated 5 months ago
- ☆48Updated 11 months ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated 10 months ago
- NLP with Rust for Python 🦀🐍☆64Updated 2 months ago
- Official repo for Learning to Reason for Long-Form Story Generation☆68Updated 3 months ago
- ☆49Updated 5 months ago