Alternatives and similar repositories for benchmarks

Users that are interested in benchmarks are comparing it to the libraries listed below

• aastroza / structured-generation-benchmark
  Structured Generation Evals
  ☆14Updated last year
• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆59Updated last year
• MegaIng / interegular
  Allows to check regexes for overlaps. Based on greenery by @qntm.
  ☆55Updated last year
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆70Updated 6 months ago
• AnswerDotAI / toolslm
  Tools to make language models a bit easier to use
  ☆60Updated last week
• thomasnormal / fewshot
  ☆29Updated last month
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆104Updated last month
• dottxt-ai / cursed
  ☆19Updated last year
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• HazyResearch / cartridges
  Storing long contexts in tiny caches with self-study
  ☆218Updated last month
• tom-pollak / claudette-pydantic
  ☆10Updated last year
• guidance-ai / jsonschemabench
  ☆67Updated 5 months ago
• IsaacRe / Syntactically-Constrained-Sampling
  LLM sampling method for enforcing syntax adherence in generated output
  ☆25Updated 2 years ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆52Updated 9 months ago
• masci / banks
  LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…
  ☆117Updated 4 months ago
• allenai / adapt-demos
  Lightweight tools for quick and easy LLM demo's
  ☆28Updated last year
• leap-laboratories / PIZZA
  An attribution library for LLMs
  ☆46Updated last year
• kevinwu23 / StanfordFineTuneBench
  ☆31Updated last year
• epfl-dlab / transformers-CFG
  🤗 A specialized library for integrating context-free grammars (CFG) in EBNF with the Hugging Face Transformers
  ☆129Updated 7 months ago
• r2d4 / parserllm
  Use context-free grammars with an LLM
  ☆175Updated last year
• AnswerDotAI / fastkmeans
  ☆86Updated 5 months ago
• parkervg / blendsql
  Query language for blending SQL and LLMs across structured + unstructured data, with type constraints.
  ☆117Updated this week
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆92Updated 2 months ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated 11 months ago
• AnswerDotAI / fastdata
  ☆159Updated last year
• lightonai / fast-plaid
  High-Performance Engine for Multi-Vector Search
  ☆189Updated this week
• mkuchnik / relm
  ReLM is a Regular Expression engine for Language Models
  ☆107Updated 2 years ago
• joshuacnf / Ctrl-G
  ☆104Updated 10 months ago
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆67Updated 7 months ago
• leloykun / mmsg
  Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.
  ☆29Updated last year