Alternatives and similar repositories for benchmarks:

Users that are interested in benchmarks are comparing it to the libraries listed below

• aastroza / structured-generation-benchmark
  Structured Generation Evals
  ☆12Updated 5 months ago
• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆53Updated last year
• dottxt-ai / cursed
  ☆19Updated 4 months ago
• MegaIng / interegular
  Allows to check regexes for overlaps. Based on greenery by @qntm.
  ☆48Updated 9 months ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆61Updated 9 months ago
• leloykun / mmsg
  Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.
  ☆27Updated 5 months ago
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆35Updated 3 weeks ago
• thomasnormal / fewshot
  ☆28Updated 5 months ago
• Neural-Dragon-AI / Cynde
  A Framework For Intelligence Farming
  ☆13Updated 10 months ago
• masci / banks
  LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…
  ☆84Updated this week
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• AnswerDotAI / toolslm
  Tools to make language models a bit easier to use
  ☆39Updated 2 weeks ago
• hamelsmu / replicate-examples
  ☆22Updated 10 months ago
• kevinwu23 / StanfordFineTuneBench
  ☆27Updated 4 months ago
• parlance-labs / langfree
  Leverage your LangChain trace data for fine tuning
  ☆41Updated 7 months ago
• arcee-ai / DAM
  ☆48Updated 4 months ago
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆37Updated 7 months ago
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆38Updated 11 months ago
• allenai / adapt-demos
  Lightweight tools for quick and easy LLM demo's
  ☆26Updated 6 months ago
• kanishkg / synchromesh
  Get language models to generate responses in a specific format reliably. Open source implementation of Synchromesh: Reliable code generat…
  ☆27Updated last year
• fblgit / model-similarity
  Simple Model Similarities Analysis
  ☆21Updated last year
• pacman100 / peft-codegen-25
  ☆24Updated last year
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆97Updated last year
• cvndsh / rebus
  REBUS: A Robust Evaluation Benchmark of Understanding Symbols
  ☆13Updated 7 months ago
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆18Updated 4 months ago
• AnswerDotAI / sqlite-minutils
  A fork of sqlite-utils with CLI etc removed
  ☆14Updated 3 months ago
• BBischof / yapping
  Verbosity control for AI agents
  ☆60Updated 10 months ago