Alternatives and similar repositories for structured-generation-benchmark

Users that are interested in structured-generation-benchmark are comparing it to the libraries listed below

• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆33Updated 4 months ago
• thomasnormal / fewshot
  ☆28Updated 2 months ago
• joshuacnf / Ctrl-G
  ☆89Updated 7 months ago
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆104Updated last year
• benlipkin / probsem
  Probabilistic LLM evaluations. [CogSci2023; ACL2023]
  ☆73Updated last year
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆94Updated 8 months ago
• AnswerDotAI / fastkmeans
  ☆68Updated last month
• commit-0 / commit0
  Commit0: Library Generation from Scratch
  ☆161Updated 3 months ago
• probcomp / LLaMPPL
  A domain-specific probabilistic programming language for modeling and inference with language models
  ☆133Updated 3 months ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated 8 months ago
• allenai / infinigram-api
  ☆77Updated last week
• vivien000 / regex-constrained-decoding
  Fast, High-Fidelity LLM Decoding with Regex Constraints
  ☆20Updated last year
• haizelabs / sphynx
  Sphynx Hallucination Induction
  ☆53Updated 6 months ago
• dottxt-ai / benchmarks
  Benchmark structured generation libraries
  ☆29Updated 10 months ago
• guidance-ai / jsonschemabench
  ☆53Updated 2 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆65Updated last year
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆18Updated 9 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated 11 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆88Updated 10 months ago
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆88Updated 10 months ago
• HazyResearch / cartridges
  Storing long contexts in tiny caches with self-study
  ☆140Updated last week
• neulab / ragged
  Retrieval Augmented Generation Generalized Evaluation Dataset
  ☆55Updated last month
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆247Updated last year
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆104Updated 5 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆49Updated 6 months ago
• huggingface / wikirace-llms
  ☆23Updated 3 months ago
• CarperAI / autocrit
  A repository for transformer critique learning and generation
  ☆90Updated last year
• liujch1998 / infini-gram
  ☆63Updated 3 weeks ago
• mkuchnik / relm
  ReLM is a Regular Expression engine for Language Models
  ☆106Updated 2 years ago
• mungg / FABLES
  ☆57Updated 11 months ago