Alternatives and similar repositories for benchmarks:

Users that are interested in benchmarks are comparing it to the libraries listed below

• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆62Updated 11 months ago
• leloykun / mmsg
  Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.
  ☆27Updated 6 months ago
• aastroza / structured-generation-benchmark
  Structured Generation Evals
  ☆12Updated 7 months ago
• arcee-ai / DAM
  ☆48Updated 6 months ago
• liujch1998 / infini-gram
  ☆37Updated this week
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• AnswerDotAI / fastkmeans
  ☆39Updated this week
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆23Updated 7 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆30Updated 7 months ago
• kevinwu23 / StanfordFineTuneBench
  ☆28Updated 5 months ago
• eth-sri / type-constrained-code-generation
  ☆12Updated this week
• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆53Updated last year
• alvarobartt / vertex-ai-huggingface-inference-toolkit
  🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)
  ☆17Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆43Updated 3 months ago
• dottxt-ai / cursed
  ☆19Updated 6 months ago
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated 2 months ago
• MegaIng / interegular
  Allows to check regexes for overlaps. Based on greenery by @qntm.
  ☆52Updated 11 months ago
• CarperAI / treasure_trove
  ☆22Updated last year
• axolotl-ai-cloud / grpo_code
  A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.
  ☆22Updated last month
• samsja / pydantic_config
  Manage ML configuration with pydantic
  ☆16Updated 5 months ago
• cognitivecomputations / kraken
  ☆66Updated 11 months ago
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated last month
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆59Updated 3 weeks ago
• aorwall / moatless-testbeds
  Moatless Testbeds allows you to create isolated testbed environments in a Kubernetes cluster where you can apply code changes through git…
  ☆11Updated last month
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆21Updated 3 months ago
• BBischof / yapping
  Verbosity control for AI agents
  ☆63Updated 11 months ago
• philschmid / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆11Updated 7 months ago
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆38Updated 2 months ago
• alonsosilvaallende / knowledge-graph-generator
  Knowledge Graph Generator app
  ☆31Updated last year
• AnswerDotAI / toolslm
  Tools to make language models a bit easier to use
  ☆44Updated last week