Alternatives and similar repositories for benchmarks

Users that are interested in benchmarks are comparing it to the libraries listed below

• aastroza / structured-generation-benchmark
  Structured Generation Evals
  ☆12Updated last year
• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆57Updated last year
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• MegaIng / interegular
  Allows to check regexes for overlaps. Based on greenery by @qntm.
  ☆54Updated last year
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆104Updated this week
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆65Updated 5 months ago
• AnswerDotAI / toolslm
  Tools to make language models a bit easier to use
  ☆54Updated last month
• dottxt-ai / cursed
  ☆19Updated 11 months ago
• r2d4 / parserllm
  Use context-free grammars with an LLM
  ☆175Updated last year
• thomasnormal / fewshot
  ☆29Updated last week
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated 3 weeks ago
• strangeloopcanon / LLMRank
  PageRank for LLMs
  ☆50Updated last month
• HazyResearch / cartridges
  Storing long contexts in tiny caches with self-study
  ☆205Updated 2 weeks ago
• samsja / pydantic_config
  Manage ML configuration with pydantic
  ☆16Updated 5 months ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated 10 months ago
• cpfiffer / self-expansion
  Code for building self-expanding knowledge graphs with Outlines, vLLM, neo4j, and Modal.
  ☆32Updated 5 months ago
• leap-laboratories / PIZZA
  An attribution library for LLMs
  ☆43Updated last year
• gpoesia / certified-reasoning
  Certified Reasoning with Language Models
  ☆31Updated last year
• mlabonne / chessllm
  ☆40Updated last year
• AnswerDotAI / fastkmeans
  ☆83Updated 3 months ago
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆64Updated 6 months ago
• leloykun / mmsg
  Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.
  ☆29Updated last year
• allenai / adapt-demos
  Lightweight tools for quick and easy LLM demo's
  ☆28Updated last year
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆27Updated 2 years ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆50Updated 8 months ago
• IsaacRe / Syntactically-Constrained-Sampling
  LLM sampling method for enforcing syntax adherence in generated output
  ☆24Updated 2 years ago
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆26Updated last year
• stas00 / python-tools
  Python tools
  ☆13Updated 2 years ago
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆38Updated 8 months ago
• stephantul / skeletoken
  Datamodels for hugging face tokenizers
  ☆86Updated this week