aastroza / structured-generation-benchmarkLinks
Structured Generation Evals
☆12Updated 9 months ago
Alternatives and similar repositories for structured-generation-benchmark
Users that are interested in structured-generation-benchmark are comparing it to the libraries listed below
Sorting:
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆32Updated 2 months ago
- ☆61Updated last week
- Lightweight tools for quick and easy LLM demo's☆28Updated 9 months ago
- ☆51Updated 7 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆57Updated 9 months ago
- ☆47Updated 4 months ago
- Benchmark structured generation libraries☆28Updated 8 months ago
- ☆61Updated 3 weeks ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆53Updated 4 months ago
- ☆28Updated last week
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆89Updated 6 months ago
- Codebase accompanying the Summary of a Haystack paper.☆78Updated 9 months ago
- Small, simple agent task environments for training and evaluation☆18Updated 7 months ago
- Official repo for Learning to Reason for Long-Form Story Generation☆63Updated 2 months ago
- Training code for Sparse Autoencoders on Embedding models☆38Updated 4 months ago
- Composable inference algorithms with LLMs and programmable logic☆69Updated 6 months ago
- ☆47Updated last year
- Simple GRPO scripts and configurations.☆58Updated 4 months ago
- Storing long contexts in tiny caches with self-study☆67Updated last week
- An attribution library for LLMs☆41Updated 9 months ago
- ☆41Updated 2 weeks ago
- ☆51Updated last year
- Simple repository for training small reasoning models☆33Updated 4 months ago
- Understanding the correlation between different LLM benchmarks☆29Updated last year
- Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.☆28Updated 8 months ago
- ☆35Updated last year
- Crispy reranking models by Mixedbread☆32Updated 3 weeks ago
- ☆38Updated last year
- Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.☆41Updated last month
- ☆86Updated 5 months ago