Alternatives and similar repositories for structured-generation-benchmark

Users that are interested in structured-generation-benchmark are comparing it to the libraries listed below

• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆34Updated 9 months ago
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆104Updated 2 months ago
• benlipkin / probsem
  Probabilistic LLM evaluations. [CogSci2023; ACL2023]
  ☆73Updated last year
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆102Updated last year
• joshuacnf / Ctrl-G
  ☆105Updated last year
• thomasnormal / fewshot
  ☆29Updated 2 months ago
• mungg / FABLES
  ☆59Updated last year
• AnswerDotAI / fastkmeans
  ☆90Updated 6 months ago
• dottxt-ai / benchmarks
  Benchmark structured generation libraries
  ☆30Updated last year
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated last year
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆82Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆53Updated 11 months ago
• huggingface / wikirace-llms
  ☆25Updated 8 months ago
• arcee-ai / DAM
  ☆55Updated last year
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆39Updated 10 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated last year
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆248Updated last year
• mixedbread-ai / mxbai-rerank
  Crispy reranking models by Mixedbread
  ☆43Updated 4 months ago
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆76Updated last year
• liujch1998 / infini-gram
  ☆90Updated last month
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆72Updated last year
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆70Updated 8 months ago
• krypticmouse / matryoshka-representation-learning
  PyTorch implementation for MRL
  ☆20Updated last year
• benlipkin / decoding
  Composable inference algorithms with LLMs and programmable logic
  ☆69Updated last year
• Zyphra / Zyda_processing
  ☆39Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆80Updated last year
• jina-ai / textbook
  distill chatGPT coding ability into small model (1b)
  ☆30Updated 2 years ago
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆111Updated last year
• guidance-ai / jsonschemabench
  ☆75Updated 7 months ago
• probcomp / LLaMPPL
  A domain-specific probabilistic programming language for modeling and inference with language models
  ☆140Updated 8 months ago