Alternatives and similar repositories for evals

Users that are interested in evals are comparing it to the libraries listed below

• eugeneyan / align-app
  ☆85Updated last year
• BBischof / yapping
  Verbosity control for AI agents
  ☆66Updated last year
• eugeneyan / visualizing-finetunes
  ☆79Updated last year
• AnswerDotAI / web2md-ext
  Get a markdown version of any webpage with a keyboard shortcut.
  ☆67Updated 10 months ago
• AnswerDotAI / claudette
  Claudette is Claude's friend
  ☆308Updated this week
• jxnl / n-levels-of-rag
  ☆198Updated last year
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆103Updated last year
• AnswerDotAI / toolslm
  Tools to make language models a bit easier to use
  ☆63Updated this week
• cohere-ai / quick-start-connectors
  This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…
  ☆155Updated last year
• AnswerDotAI / web2md
  Convert a web page to markdown
  ☆80Updated last year
• MaximeRivest / attachments
  Easiest way to give context to LLMs; Attachments has the ambition to be the general funnel for any files to be transformed into images+te…
  ☆334Updated 3 months ago
• jjallaire / inspect-llm-workshop
  ☆54Updated last year
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• 567-labs / fastllm
  A collection of LLM services you can self host via docker or modal labs to support your applications development
  ☆198Updated last year
• instructor-ai / cloud
  Annoucing Instructor Cloud
  ☆38Updated last year
• ai-evals-course / isaac-fasthtml-workshop
  ☆67Updated 5 months ago
• braintrustdata / braintrust-cookbook
  ☆49Updated 2 weeks ago
• 567-labs / systematically-improving-rag
  ☆205Updated last month
• hamelsmu / claudesave
  A Chrome extension that saves conversations with Claude to GitHubGists or your clipboard.
  ☆89Updated last year
• jxnl / blog
  ☆174Updated 2 weeks ago
• jlewi / foyle
  Foyle is a copilot to help developers deploy and operate their applications.
  ☆133Updated 9 months ago
• CyrusNuevoDia / llegos
  A strongly typed Python DSL for developing message passing multi agent systems
  ☆53Updated last year
• jxnl / instructor-classify
  ☆37Updated 8 months ago
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆50Updated last year
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated 2 years ago
• AnswerDotAI / GeminiSave
  ☆55Updated 8 months ago
• modal-labs / awesome-modal
  A curated list of amazingly awesome Modal applications, demos, and shiny things. Inspired by awesome-php.
  ☆169Updated last week
• abacaj / openhermes-function-calling
  ☆135Updated 2 years ago
• yoheinakajima / autofinetune
  auto fine tune of models with synthetic data
  ☆78Updated last year
• SpellcraftAI / oaib
  Use the OpenAI Batch tool to make async batch requests to the OpenAI API.
  ☆101Updated last year