aastroza / structured-generation-benchmarkLinks
Structured Generation Evals
☆14Updated last year
Alternatives and similar repositories for structured-generation-benchmark
Users that are interested in structured-generation-benchmark are comparing it to the libraries listed below
Sorting:
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 8 months ago
- ☆29Updated 2 months ago
- minimal pytorch implementation of bm25 (with sparse tensors)☆104Updated last month
- An introduction to LLM Sampling☆79Updated last year
- Benchmark structured generation libraries☆30Updated last year
- Probabilistic LLM evaluations. [CogSci2023; ACL2023]☆73Updated last year
- ReLM is a Regular Expression engine for Language Models☆107Updated 2 years ago
- ☆25Updated 7 months ago
- ☆105Updated 11 months ago
- An attribution library for LLMs☆46Updated last year
- ☆53Updated 10 months ago
- ☆90Updated 5 months ago
- Score LLM pretraining data with classifiers☆55Updated 2 years ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆71Updated last year
- ☆55Updated last year
- Functional Benchmarks and the Reasoning Gap☆90Updated last year
- Training code for Sparse Autoencoders on Embedding models☆39Updated 9 months ago
- PyLate efficient inference engine☆68Updated 3 months ago
- QLoRA with Enhanced Multi GPU Support☆37Updated 2 years ago
- Composable inference algorithms with LLMs and programmable logic☆69Updated last year
- PyTorch implementation for MRL☆20Updated last year
- Lightweight tools for quick and easy LLM demo's☆28Updated last year
- Extract full next-token probabilities via language model APIs☆248Updated last year
- Fast, High-Fidelity LLM Decoding with Regex Constraints☆21Updated last year
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆189Updated 5 months ago
- ☆87Updated 2 weeks ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆150Updated 10 months ago
- ☆90Updated this week
- Losslessly encode text natively with arithmetic coding and HuggingFace Transformers☆76Updated last month
- Official repo for Learning to Reason for Long-Form Story Generation☆73Updated 8 months ago