aastroza / structured-generation-benchmark
Structured Generation Evals
☆12Updated 5 months ago
Alternatives and similar repositories for structured-generation-benchmark:
Users that are interested in structured-generation-benchmark are comparing it to the libraries listed below
- Benchmark structured generation libraries☆26Updated 4 months ago
- Training code for Sparse Autoencoders on Embedding models☆35Updated 2 weeks ago
- ☆28Updated 5 months ago
- ☆80Updated 2 months ago
- ☆48Updated 4 months ago
- Understanding the correlation between different LLM benchmarks☆29Updated last year
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆41Updated 11 months ago
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆70Updated 3 months ago
- Repository for "I am a Strange Dataset: Metalinguistic Tests for Language Models"☆41Updated last year
- Experiments for efforts to train a new and improved t5☆77Updated 10 months ago
- ☆38Updated 10 months ago
- Tools to make language models a bit easier to use☆37Updated last week
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 6 months ago
- Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.☆26Updated 4 months ago
- ☆48Updated last year
- An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)☆30Updated 8 months ago
- Functional Benchmarks and the Reasoning Gap☆84Updated 5 months ago
- Lightweight tools for quick and easy LLM demo's☆26Updated 5 months ago
- Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"☆22Updated 6 months ago
- PyTorch library for Active Fine-Tuning☆59Updated 3 weeks ago
- Losslessly encode text natively with arithmetic coding and HuggingFace Transformers☆72Updated 7 months ago
- ☆22Updated 9 months ago
- ☆47Updated 6 months ago
- Codebase accompanying the Summary of a Haystack paper.☆75Updated 5 months ago
- Composable inference algorithms with LLMs and programmable logic☆66Updated 3 months ago
- ☆20Updated last year