Alternatives and similar repositories for benchmarks

Users that are interested in benchmarks are comparing it to the libraries listed below

• aastroza / structured-generation-benchmark
  Structured Generation Evals
  ☆14Updated last year
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated 2 years ago
• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆59Updated 2 years ago
• AnswerDotAI / toolslm
  Tools to make language models a bit easier to use
  ☆64Updated this week
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆71Updated 8 months ago
• MegaIng / interegular
  Allows to check regexes for overlaps. Based on greenery by @qntm.
  ☆56Updated last year
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆27Updated 2 years ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated last year
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆104Updated 3 months ago
• masci / banks
  LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…
  ☆121Updated last week
• alvarobartt / vertex-ai-huggingface-inference-toolkit
  🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)
  ☆17Updated last year
• AnswerDotAI / fastdata
  ☆162Updated last year
• leap-laboratories / PIZZA
  An attribution library for LLMs
  ☆46Updated last year
• kevinwu23 / StanfordFineTuneBench
  ☆31Updated last year
• leloykun / mmsg
  Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.
  ☆29Updated last year
• HazyResearch / cartridges
  Storing long contexts in tiny caches with self-study
  ☆236Updated 2 months ago
• thomasnormal / fewshot
  ☆29Updated 3 months ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆83Updated 2 years ago
• guidance-ai / jsonschemabench
  ☆76Updated 7 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆53Updated last year
• strangeloopcanon / LLMRank
  PageRank for LLMs
  ☆52Updated 5 months ago
• lightonai / pylate-rs
  PyLate efficient inference engine
  ☆71Updated last month
• CyrusNuevoDia / llegos
  A strongly typed Python DSL for developing message passing multi agent systems
  ☆53Updated last year
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆68Updated 9 months ago
• brendanhogan / picoDeepResearch
  ☆67Updated 8 months ago
• AnswerDotAI / fastkmeans
  ☆90Updated 7 months ago
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated 4 months ago
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆47Updated last year
• joshuacnf / Ctrl-G
  ☆105Updated last year
• vgel / logitloom
  explore token trajectory trees on instruct and base models
  ☆150Updated 8 months ago