Alternatives and similar repositories for structured-generation-benchmark

Users that are interested in structured-generation-benchmark are comparing it to the libraries listed below

• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆104Updated last year
• AnswerDotAI / fastkmeans
  ☆77Updated 3 months ago
• thomasnormal / fewshot
  ☆28Updated 3 months ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆34Updated 5 months ago
• benlipkin / probsem
  Probabilistic LLM evaluations. [CogSci2023; ACL2023]
  ☆72Updated last year
• dottxt-ai / benchmarks
  Benchmark structured generation libraries
  ☆29Updated 11 months ago
• joshuacnf / Ctrl-G
  ☆102Updated 9 months ago
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆98Updated 10 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆66Updated last year
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆66Updated last week
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆76Updated last year
• leap-laboratories / PIZZA
  An attribution library for LLMs
  ☆42Updated last year
• mkuchnik / relm
  ReLM is a Regular Expression engine for Language Models
  ☆106Updated 2 years ago
• liujch1998 / infini-gram
  ☆71Updated 2 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆49Updated 8 months ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆65Updated 4 months ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated 9 months ago
• ctlllll / understanding_llm_benchmarks
  Understanding the correlation between different LLM benchmarks
  ☆29Updated last year
• benlipkin / decoding
  Composable inference algorithms with LLMs and programmable logic
  ☆69Updated 10 months ago
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆80Updated last year
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated last year
• krypticmouse / matryoshka-representation-learning
  PyTorch implementation for MRL
  ☆19Updated last year
• haizelabs / j1-micro
  j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.
  ☆98Updated 2 months ago
• guidance-ai / jsonschemabench
  ☆61Updated 3 months ago
• neulab / ragged
  Retrieval Augmented Generation Generalized Evaluation Dataset
  ☆56Updated 2 months ago
• Alex-Gurung / ReasoningNCP
  Official repo for Learning to Reason for Long-Form Story Generation
  ☆71Updated 5 months ago
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆102Updated last year
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated last year
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆247Updated last year