Alternatives and similar repositories for structured-generation-benchmark:

Users that are interested in structured-generation-benchmark are comparing it to the libraries listed below

• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆33Updated last week
• thomasnormal / fewshot
  ☆28Updated 7 months ago
• leap-laboratories / PIZZA
  An attribution library for LLMs
  ☆38Updated 7 months ago
• AnswerDotAI / fastkmeans
  ☆32Updated this week
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆38Updated last month
• arcee-ai / DAM
  ☆48Updated 5 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated 2 months ago
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆55Updated 7 months ago
• allenai / adapt-demos
  Lightweight tools for quick and easy LLM demo's
  ☆26Updated 7 months ago
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆83Updated 4 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆83Updated 4 months ago
• liujch1998 / infini-gram
  ☆33Updated 2 weeks ago
• axolotl-ai-cloud / grpo_code
  A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.
  ☆22Updated 3 weeks ago
• benlipkin / probsem
  Probabilistic LLM evaluations. [CogSci2023; ACL2023]
  ☆73Updated 8 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆41Updated 2 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated 2 months ago
• AnswerDotAI / toolslm
  Tools to make language models a bit easier to use
  ☆42Updated last week
• ctlllll / understanding_llm_benchmarks
  Understanding the correlation between different LLM benchmarks
  ☆29Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆77Updated 7 months ago
• dottxt-ai / benchmarks
  Benchmark structured generation libraries
  ☆26Updated 5 months ago
• Zyphra / Zyda_processing
  ☆33Updated 10 months ago
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆18Updated 5 months ago
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆39Updated last month
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆77Updated last year
• aorwall / moatless-testbeds
  Moatless Testbeds allows you to create isolated testbed environments in a Kubernetes cluster where you can apply code changes through git…
  ☆11Updated 2 weeks ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆77Updated 4 months ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆62Updated 10 months ago
• castorini / hf-spacerini
  Plug-and-play Search Interfaces with Pyserini and Hugging Face
  ☆31Updated last year
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆37Updated 9 months ago