aastroza / structured-generation-benchmarkLinks
Structured Generation Evals
☆14Updated last year
Alternatives and similar repositories for structured-generation-benchmark
Users that are interested in structured-generation-benchmark are comparing it to the libraries listed below
Sorting:
- ☆29Updated last month
- ☆104Updated 10 months ago
- minimal pytorch implementation of bm25 (with sparse tensors)☆104Updated last month
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 7 months ago
- Extract full next-token probabilities via language model APIs☆248Updated last year
- ☆25Updated 6 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆70Updated last year
- An introduction to LLM Sampling☆79Updated 11 months ago
- Experiments for efforts to train a new and improved t5☆76Updated last year
- Training code for Sparse Autoencoders on Embedding models☆38Updated 9 months ago
- Simple GRPO scripts and configurations.☆59Updated 10 months ago
- ☆86Updated 5 months ago
- ☆67Updated 5 months ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆67Updated 2 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- A domain-specific probabilistic programming language for modeling and inference with language models☆137Updated 7 months ago
- ☆144Updated 2 months ago
- ☆50Updated last year
- Probabilistic LLM evaluations. [CogSci2023; ACL2023]☆73Updated last year
- Benchmark structured generation libraries☆30Updated last year
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆101Updated last year
- ☆58Updated 2 weeks ago
- ReLM is a Regular Expression engine for Language Models☆107Updated 2 years ago
- ☆87Updated this week
- PyTorch implementation for MRL☆20Updated last year
- ☆83Updated 3 months ago
- Mixing Language Models with Self-Verification and Meta-Verification☆110Updated 11 months ago
- ☆39Updated last year
- ☆55Updated last year
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆20Updated last month