Alternatives and similar repositories for benchmarks:

Users that are interested in benchmarks are comparing it to the libraries listed below

• MegaIng / interegular
  Allows to check regexes for overlaps. Based on greenery by @qntm.
  ☆47Updated 7 months ago
• leloykun / mmsg
  Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.
  ☆26Updated 3 months ago
• dottxt-ai / cursed
  ☆15Updated 2 months ago
• aastroza / structured-generation-benchmark
  Structured Generation Evals
  ☆12Updated 4 months ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• masci / banks
  LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…
  ☆72Updated this week
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆60Updated 7 months ago
• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆51Updated 11 months ago
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆35Updated 2 months ago
• alvarobartt / vertex-ai-huggingface-inference-toolkit
  🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)
  ☆17Updated 10 months ago
• philschmid / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆10Updated 4 months ago
• thomasnormal / fewshot
  ☆27Updated 4 months ago
• enjalot / fineweb-modal
  Using modal.com to process FineWeb-edu data
  ☆19Updated last month
• allenai / adapt-demos
  Lightweight tools for quick and easy LLM demo's
  ☆26Updated 4 months ago
• simonw / llm-cluster
  LLM plugin for clustering embeddings
  ☆66Updated 10 months ago
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated 10 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆29Updated 4 months ago
• adrinjalali / joblib-modal
  A library to use `modal` as a backend for `joblib`.
  ☆25Updated 2 weeks ago
• agential-ai / agential
  🔔🧠 Easily experiment with popular language agents across diverse reasoning/decision-making benchmarks!
  ☆51Updated this week
• leap-laboratories / PIZZA
  An attribution library for LLMs
  ☆35Updated 4 months ago
• cvndsh / rebus
  REBUS: A Robust Evaluation Benchmark of Understanding Symbols
  ☆13Updated 5 months ago
• freedmand / interpogate
  A visual tool to interpret and understand PyTorch machine learning models
  ☆16Updated 11 months ago
• mlabonne / chessllm
  ☆33Updated last year
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆30Updated last month
• CarperAI / treasure_trove
  ☆22Updated last year
• cfahlgren1 / hf-data-explorer
  Chrome Extension for exploring Hugging Face datasets 🔎
  ☆49Updated 4 months ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆42Updated this week
• Neural-Dragon-AI / Cynde
  A Framework For Intelligence Farming
  ☆13Updated 8 months ago
• intellectronica / battle-of-the-semantics
  GraphRag vs Embeddings
  ☆13Updated 6 months ago
• joshuacnf / Ctrl-G
  ☆80Updated 3 weeks ago