Alternatives and similar repositories for benchmarks

Users that are interested in benchmarks are comparing it to the libraries listed below

• MegaIng / interegular
  Allows to check regexes for overlaps. Based on greenery by @qntm.
  ☆53Updated last year
• aastroza / structured-generation-benchmark
  Structured Generation Evals
  ☆12Updated 9 months ago
• leap-laboratories / PIZZA
  An attribution library for LLMs
  ☆42Updated 9 months ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆63Updated 2 months ago
• AnswerDotAI / fastkmeans
  ☆62Updated last week
• thomasnormal / fewshot
  ☆28Updated 3 weeks ago
• lightonai / fast-plaid
  High-Performance Engine for Multi-Vector Search
  ☆126Updated last month
• cvndsh / rebus
  REBUS: A Robust Evaluation Benchmark of Understanding Symbols
  ☆13Updated 11 months ago
• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆55Updated last year
• mlabonne / chessllm
  ☆38Updated last year
• dottxt-ai / cursed
  ☆19Updated 8 months ago
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆102Updated last year
• AnswerDotAI / toolslm
  Tools to make language models a bit easier to use
  ☆48Updated 2 weeks ago
• kevinwu23 / StanfordFineTuneBench
  ☆30Updated 8 months ago
• leloykun / mmsg
  Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.
  ☆28Updated 8 months ago
• masci / banks
  LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…
  ☆105Updated 2 weeks ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• liujch1998 / infini-gram
  ☆54Updated last month
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆48Updated 5 months ago
• parkervg / blendsql
  Query language for blending SQL and LLMs across structured + unstructured data, with type constraints.
  ☆106Updated this week
• HazyResearch / cartridges
  Storing long contexts in tiny caches with self-study
  ☆89Updated this week
• alvarobartt / vertex-ai-huggingface-inference-toolkit
  🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)
  ☆17Updated last year
• parlance-labs / langfree
  Leverage your LangChain trace data for fine tuning
  ☆41Updated 11 months ago
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆37Updated 11 months ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆32Updated 3 months ago
• stas00 / python-tools
  Python tools
  ☆12Updated last year
• arcee-ai / DAM
  ☆52Updated 8 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆30Updated 9 months ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆84Updated last month
• lightonai / ducksearch
  Efficient BM25 with DuckDB 🦆
  ☆52Updated 6 months ago