Alternatives and similar repositories for evals

Users that are interested in evals are comparing it to the libraries listed below

• BBischof / yapping
  Verbosity control for AI agents
  ☆65Updated last year
• instructor-ai / cloud
  Annoucing Instructor Cloud
  ☆37Updated last year
• eugeneyan / align-app
  ☆82Updated 10 months ago
• hamelsmu / claudesave
  A Chrome extension that saves conversations with Claude to GitHubGists or your clipboard.
  ☆87Updated 10 months ago
• AnswerDotAI / web2md-ext
  Get a markdown version of any webpage with a keyboard shortcut.
  ☆66Updated 7 months ago
• MaximeRivest / attachments
  Easiest way to give context to LLMs; Attachments has the ambition to be the general funnel for any files to be transformed into images+te…
  ☆301Updated 2 weeks ago
• jxnl / blog
  ☆167Updated 2 weeks ago
• eugeneyan / visualizing-finetunes
  ☆78Updated last year
• braintrustdata / braintrust-cookbook
  ☆38Updated this week
• jxnl / n-levels-of-rag
  ☆196Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆50Updated last year
• cohere-ai / quick-start-connectors
  This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…
  ☆151Updated 11 months ago
• ai-evals-course / isaac-fasthtml-workshop
  ☆61Updated last month
• 567-labs / systematically-improving-rag
  ☆180Updated last week
• AnswerDotAI / GeminiSave
  ☆52Updated 5 months ago
• 567-labs / fastllm
  A collection of LLM services you can self host via docker or modal labs to support your applications development
  ☆195Updated last year
• seanchatmangpt / dspygen
  A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.
  ☆130Updated 11 months ago
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆103Updated last year
• AnswerDotAI / web2md
  Convert a web page to markdown
  ☆78Updated last year
• AnswerDotAI / claudette
  Claudette is Claude's friend
  ☆278Updated 3 weeks ago
• AnswerDotAI / toolslm
  Tools to make language models a bit easier to use
  ☆54Updated last week
• 567-labs / kura
  Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…
  ☆329Updated 3 weeks ago
• yoheinakajima / jsondr
  converts url content into JSON with a simple prefix
  ☆71Updated last year
• Ziems / arbor
  A framework for optimizing DSPy programs with RL
  ☆182Updated last week
• parlance-labs / mcp-llms.txt
  Minimal example of MCP for parsing llms.txt
  ☆40Updated 5 months ago
• swyxio / openlangmem
  ☆47Updated last year
• modal-labs / awesome-modal
  A curated list of amazingly awesome Modal applications, demos, and shiny things. Inspired by awesome-php.
  ☆157Updated last month
• SpellcraftAI / oaib
  Use the OpenAI Batch tool to make async batch requests to the OpenAI API.
  ☆100Updated last year
• MaximeRivest / functai
  ☆76Updated 3 weeks ago
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆38Updated last year