Alternatives and similar repositories for structured-generation-benchmark

Users that are interested in structured-generation-benchmark are comparing it to the libraries listed below

• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆33Updated 5 months ago
• benlipkin / probsem
  Probabilistic LLM evaluations. [CogSci2023; ACL2023]
  ☆73Updated last year
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆104Updated last year
• thomasnormal / fewshot
  ☆28Updated 2 months ago
• AnswerDotAI / fastkmeans
  ☆69Updated 2 months ago
• joshuacnf / Ctrl-G
  ☆99Updated 8 months ago
• guidance-ai / jsonschemabench
  ☆58Updated 3 months ago
• huggingface / wikirace-llms
  ☆23Updated 4 months ago
• leap-laboratories / PIZZA
  An attribution library for LLMs
  ☆42Updated last year
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆38Updated 6 months ago
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated 6 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆65Updated last year
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆80Updated last year
• dottxt-ai / benchmarks
  Benchmark structured generation libraries
  ☆29Updated 10 months ago
• lightonai / pylate-rs
  PyLate efficient inference engine
  ☆64Updated last week
• mixedbread-ai / mxbai-rerank
  Crispy reranking models by Mixedbread
  ☆35Updated this week
• allenai / infinigram-api
  ☆80Updated 2 weeks ago
• google-deepmind / mishax
  ☆141Updated last week
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated 11 months ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated 9 months ago
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆89Updated 11 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆88Updated 11 months ago
• Alex-Gurung / ReasoningNCP
  Official repo for Learning to Reason for Long-Form Story Generation
  ☆69Updated 4 months ago
• luyug / magix
  Supercharge huggingface transformers with model parallelism.
  ☆77Updated last month
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆248Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆49Updated 7 months ago
• AnswerDotAI / toolslm
  Tools to make language models a bit easier to use
  ☆54Updated 2 months ago
• TristanThrush / i-am-a-strange-dataset
  Repository for "I am a Strange Dataset: Metalinguistic Tests for Language Models"
  ☆44Updated last year
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆76Updated last year
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆63Updated last week