Alternatives and similar repositories for benchmarks

Users that are interested in benchmarks are comparing it to the libraries listed below

• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆62Updated last month
• aastroza / structured-generation-benchmark
  Structured Generation Evals
  ☆12Updated 9 months ago
• arcee-ai / DAM
  ☆51Updated 7 months ago
• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆53Updated last year
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated 3 months ago
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆38Updated 3 months ago
• CarperAI / treasure_trove
  ☆22Updated last year
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆30Updated 9 months ago
• thomasnormal / fewshot
  ☆28Updated this week
• parlance-labs / langfree
  Leverage your LangChain trace data for fine tuning
  ☆41Updated 10 months ago
• HazyResearch / cartridges
  Storing long contexts in tiny caches with self-study
  ☆67Updated this week
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆24Updated 8 months ago
• Neural-Dragon-AI / Cynde
  A Framework For Intelligence Farming
  ☆14Updated 2 months ago
• AnswerDotAI / fastkmeans
  ☆60Updated last week
• ScalingIntelligence / codemonkeys
  ☆41Updated 4 months ago
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• adrinjalali / joblib-modal
  A library to use `modal` as a backend for `joblib`.
  ☆28Updated 5 months ago
• leloykun / mmsg
  Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.
  ☆28Updated 8 months ago
• kevinwu23 / StanfordFineTuneBench
  ☆30Updated 7 months ago
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆33Updated 4 months ago
• samsja / pydantic_config
  Manage ML configuration with pydantic
  ☆16Updated last month
• alvarobartt / vertex-ai-huggingface-inference-toolkit
  🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)
  ☆17Updated last year
• allenai / adapt-demos
  Lightweight tools for quick and easy LLM demo's
  ☆28Updated 9 months ago
• guidance-ai / jsonschemabench
  ☆41Updated last week
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 2 months ago
• stas00 / python-tools
  Python tools
  ☆12Updated last year
• Pleias / OCRoscope
  Small python package to measure OCR quality and other related metrics.
  ☆23Updated last year
• lancedb / ragged
  ☆19Updated 8 months ago
• axolotl-ai-cloud / grpo_code
  A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.
  ☆30Updated 2 months ago