Alternatives and similar repositories for benchmarks:

Users that are interested in benchmarks are comparing it to the libraries listed below

• MegaIng / interegular
  Allows to check regexes for overlaps. Based on greenery by @qntm.
  ☆49Updated 10 months ago
• aastroza / structured-generation-benchmark
  Structured Generation Evals
  ☆12Updated 6 months ago
• dottxt-ai / cursed
  ☆19Updated 5 months ago
• thomasnormal / fewshot
  ☆28Updated 6 months ago
• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆53Updated last year
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆61Updated 10 months ago
• leloykun / mmsg
  Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.
  ☆27Updated 6 months ago
• mlabonne / chessllm
  ☆34Updated last year
• arcee-ai / DAM
  ☆48Updated 5 months ago
• masci / banks
  LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…
  ☆90Updated this week
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆40Updated 2 months ago
• kevinwu23 / StanfordFineTuneBench
  ☆28Updated 5 months ago
• CarperAI / treasure_trove
  ☆22Updated last year
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆38Updated last month
• AnswerDotAI / fastkmeans
  ☆21Updated this week
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆30Updated 6 months ago
• stas00 / python-tools
  Python tools
  ☆12Updated last year
• strangeloopcanon / LLMRank
  PageRank for LLMs
  ☆41Updated last week
• alvarobartt / vertex-ai-huggingface-inference-toolkit
  🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)
  ☆17Updated last year
• adrinjalali / joblib-modal
  A library to use `modal` as a backend for `joblib`.
  ☆28Updated 3 months ago
• philschmid / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆11Updated 6 months ago
• axolotl-ai-cloud / grpo_code
  A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.
  ☆22Updated 2 weeks ago
• morgangiraud / text-to-sql-proto
  A text-to-SQL prototype on the northwind sqlite dataset
  ☆12Updated 6 months ago
• modal-labs / ci-on-modal
  A sample pattern for running CI tests on Modal
  ☆17Updated this week
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆37Updated last year
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆77Updated 4 months ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆53Updated this week
• Watchfulio / dataset-generator
  A new way to generate large quantities of high quality synthetic data (on par with GPT-4), with better controllability, at a fraction of …
  ☆22Updated 6 months ago
• liujch1998 / infini-gram
  ☆28Updated last week
• leap-laboratories / PIZZA
  An attribution library for LLMs
  ☆38Updated 7 months ago