Alternatives and similar repositories for structured-generation-benchmark

Users that are interested in structured-generation-benchmark are comparing it to the libraries listed below

• thomasnormal / fewshot
  ☆28Updated 8 months ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆32Updated last month
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆38Updated 3 months ago
• AidanCooper / constrained-decoding
  A guide to structured generation using constrained decoding
  ☆11Updated 11 months ago
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆18Updated 7 months ago
• ctlllll / understanding_llm_benchmarks
  Understanding the correlation between different LLM benchmarks
  ☆29Updated last year
• benlipkin / probsem
  Probabilistic LLM evaluations. [CogSci2023; ACL2023]
  ☆73Updated 10 months ago
• TheDuckAI / arb
  Advanced Reasoning Benchmark Dataset for LLMs
  ☆46Updated last year
• AnswerDotAI / fastkmeans
  ☆57Updated 3 weeks ago
• Zyphra / Zyda_processing
  ☆34Updated 11 months ago
• leloykun / mmsg
  Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.
  ☆28Updated 7 months ago
• VITA-Group / ChainCoder
  [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …
  ☆40Updated last year
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆57Updated 9 months ago
• dottxt-ai / benchmarks
  Benchmark structured generation libraries
  ☆28Updated 7 months ago
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆37Updated 10 months ago
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆43Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆78Updated 8 months ago
• ahmed-moubtahij / TokenHealer
  ☆22Updated last year
• TristanThrush / i-am-a-strange-dataset
  Repository for "I am a Strange Dataset: Metalinguistic Tests for Language Models"
  ☆44Updated last year
• da03 / WildVisualizer
  ☆22Updated 7 months ago
• joshuacnf / Ctrl-G
  ☆83Updated 5 months ago
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆25Updated 2 years ago
• aorwall / moatless-testbeds
  Moatless Testbeds allows you to create isolated testbed environments in a Kubernetes cluster where you can apply code changes through git…
  ☆12Updated last month
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆19Updated 4 months ago
• goncalorafaria / qalign
  QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.
  ☆24Updated 2 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 9 months ago
• guidance-ai / jsonschemabench
  ☆39Updated last month
• huggingface / wikirace-llms
  ☆21Updated last month
• bigcode-project / bigcode-encoder
  ☆30Updated last year
• allenai / infinigram-api
  ☆58Updated 3 weeks ago