Alternatives and similar repositories for evals:

Users that are interested in evals are comparing it to the libraries listed below

• eugeneyan / align-app
  ☆58Updated 4 months ago
• hamelsmu / claudesave
  A Chrome extension that saves conversations with Claude to GitHubGists or your clipboard.
  ☆80Updated 3 months ago
• BBischof / yapping
  Verbosity control for AI agents
  ☆60Updated 9 months ago
• AnswerDotAI / web2md-ext
  Get a markdown version of any webpage with a keyboard shortcut.
  ☆60Updated last month
• instructor-ai / cloud
  Annoucing Instructor Cloud
  ☆34Updated 7 months ago
• AnswerDotAI / toolslm
  Tools to make language models a bit easier to use
  ☆39Updated 2 weeks ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 2 weeks ago
• eugeneyan / visualizing-finetunes
  ☆77Updated 9 months ago
• ivanleomk / kura
  Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…
  ☆90Updated last month
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆37Updated 7 months ago
• JeezAI / DSPy_matchmaking
  A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…
  ☆59Updated 11 months ago
• arihanv / fasthtml-modal
  Deploy a FastHTML app in just a few lines of simple python code on Modal's serverless infra.
  ☆26Updated 7 months ago
• braintrustdata / braintrust-cookbook
  ☆28Updated last week
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆47Updated last year
• AnswerDotAI / web2md
  Convert a web page to markdown
  ☆66Updated 6 months ago
• yoheinakajima / jsondr
  converts url content into JSON with a simple prefix
  ☆67Updated 10 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆76Updated 9 months ago
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆100Updated last year
• yasyf / anthropic-computer-use-modal
  Anthropic Computer Use with Modal Sandboxes
  ☆31Updated 4 months ago
• parlance-labs / langfree
  Leverage your LangChain trace data for fine tuning
  ☆41Updated 7 months ago
• modal-labs / awesome-modal
  A curated list of amazingly awesome Modal applications, demos, and shiny things. Inspired by awesome-php.
  ☆124Updated this week
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• BerriAI / bettertest
  ☆75Updated last year
• jacoblee93 / oss-model-extraction-evals
  ☆31Updated last year
• yoheinakajima / quick_email_scripts
  A couple scripts to grab stats from email
  ☆42Updated 6 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆134Updated 5 months ago
• Arbaaz-Mahmood / cognosis-II
  ☆4Updated 7 months ago
• FanaHOVA / openai-o1-code-interpreter
  Code interpreter support for o1
  ☆32Updated 6 months ago
• yoheinakajima / autofinetune
  auto fine tune of models with synthetic data
  ☆74Updated last year