Alternatives and similar repositories for benchmarks:

Users that are interested in benchmarks are comparing it to the libraries listed below

• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆51Updated last year
• dottxt-ai / cursed
  ☆16Updated 3 months ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆61Updated 8 months ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• AnswerDotAI / toolslm
  Tools to make language models a bit easier to use
  ☆34Updated 3 weeks ago
• MegaIng / interegular
  Allows to check regexes for overlaps. Based on greenery by @qntm.
  ☆47Updated 8 months ago
• CarperAI / treasure_trove
  ☆22Updated last year
• enjalot / fineweb-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 2 months ago
• simonw / llm-sentence-transformers
  LLM plugin for embeddings using sentence-transformers
  ☆46Updated this week
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆30Updated 2 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆29Updated 4 months ago
• thomasnormal / fewshot
  ☆26Updated 4 months ago
• pacman100 / peft-codegen-25
  ☆24Updated last year
• masci / banks
  LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…
  ☆76Updated 2 weeks ago
• leap-laboratories / PIZZA
  An attribution library for LLMs
  ☆37Updated 4 months ago
• alvarobartt / vertex-ai-huggingface-inference-toolkit
  🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)
  ☆17Updated 10 months ago
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated 11 months ago
• gpoesia / certified-reasoning
  Certified Reasoning with Language Models
  ☆31Updated last year
• simonw / llm-cluster
  LLM plugin for clustering embeddings
  ☆68Updated 11 months ago
• leloykun / mmsg
  Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.
  ☆26Updated 3 months ago
• aastroza / structured-generation-benchmark
  Structured Generation Evals
  ☆12Updated 4 months ago
• JustlyAI / lmss_entity_extractor
  Tool to apply Legal Matter Specification Standard (LMSS) to documents
  ☆12Updated 6 months ago
• Neural-Dragon-AI / Cynde
  A Framework For Intelligence Farming
  ☆13Updated 8 months ago
• xjdr-alt / muzero_sketch
  ☆37Updated 6 months ago
• parlance-labs / langfree
  Leverage your LangChain trace data for fine tuning
  ☆41Updated 6 months ago
• kevinwu23 / StanfordFineTuneBench
  ☆27Updated 3 months ago
• cognitivecomputations / kraken
  ☆65Updated 8 months ago
• hamelsmu / replicate-examples
  ☆22Updated 9 months ago