Alternatives and similar repositories for benchmarks

Users that are interested in benchmarks are comparing it to the libraries listed below

• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆62Updated 3 weeks ago
• alvarobartt / vertex-ai-huggingface-inference-toolkit
  🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)
  ☆17Updated last year
• thomasnormal / fewshot
  ☆28Updated 8 months ago
• aastroza / structured-generation-benchmark
  Structured Generation Evals
  ☆12Updated 8 months ago
• leloykun / mmsg
  Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.
  ☆27Updated 7 months ago
• AnswerDotAI / fastkmeans
  ☆57Updated 2 weeks ago
• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆53Updated last year
• MegaIng / interegular
  Allows to check regexes for overlaps. Based on greenery by @qntm.
  ☆53Updated 11 months ago
• arcee-ai / DAM
  ☆49Updated 6 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆43Updated 3 months ago
• allenai / adapt-demos
  Lightweight tools for quick and easy LLM demo's
  ☆27Updated 8 months ago
• ajtejankar / mixtral-vis-moe
  Visualize expert firing frequencies across sentences in the Mixtral MoE model
  ☆18Updated last year
• guidance-ai / jsonschemabench
  ☆38Updated last month
• kevinwu23 / StanfordFineTuneBench
  ☆29Updated 6 months ago
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• leap-laboratories / PIZZA
  An attribution library for LLMs
  ☆41Updated 8 months ago
• illuin-tech / contextual-embeddings
  Model implementation for the contextual embeddings project
  ☆26Updated this week
• samsja / pydantic_config
  Manage ML configuration with pydantic
  ☆16Updated 2 weeks ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• mlabonne / chessllm
  ☆36Updated last year
• foundation-model-stack / fms-model-optimizer
  FMS Model Optimizer is a framework for developing reduced precision neural network models.
  ☆20Updated last week
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆29Updated 8 months ago
• CarperAI / treasure_trove
  ☆22Updated last year
• ScalingIntelligence / codemonkeys
  ☆41Updated 4 months ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆78Updated 5 months ago
• cvndsh / rebus
  REBUS: A Robust Evaluation Benchmark of Understanding Symbols
  ☆13Updated 9 months ago
• liujch1998 / infini-gram
  ☆49Updated 2 weeks ago
• xjdr-alt / muzero_sketch
  ☆38Updated 10 months ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆32Updated last month
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆70Updated this week