Alternatives and similar repositories for evals

Users that are interested in evals are comparing it to the libraries listed below

• BBischof / yapping
  Verbosity control for AI agents
  ☆64Updated last year
• eugeneyan / align-app
  ☆83Updated last year
• AnswerDotAI / web2md-ext
  Get a markdown version of any webpage with a keyboard shortcut.
  ☆67Updated 8 months ago
• instructor-ai / cloud
  Annoucing Instructor Cloud
  ☆38Updated last year
• hamelsmu / claudesave
  A Chrome extension that saves conversations with Claude to GitHubGists or your clipboard.
  ☆89Updated 11 months ago
• 567-labs / fastllm
  A collection of LLM services you can self host via docker or modal labs to support your applications development
  ☆196Updated last year
• eugeneyan / visualizing-finetunes
  ☆77Updated last year
• MaximeRivest / attachments
  Easiest way to give context to LLMs; Attachments has the ambition to be the general funnel for any files to be transformed into images+te…
  ☆319Updated last month
• jxnl / n-levels-of-rag
  ☆196Updated last year
• AnswerDotAI / web2md
  Convert a web page to markdown
  ☆79Updated last year
• braintrustdata / braintrust-cookbook
  ☆42Updated last week
• cohere-ai / quick-start-connectors
  This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…
  ☆151Updated last year
• ai-evals-course / isaac-fasthtml-workshop
  ☆63Updated 3 months ago
• 567-labs / systematically-improving-rag
  ☆188Updated last month
• AnswerDotAI / GeminiSave
  ☆53Updated 6 months ago
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆50Updated last year
• AnswerDotAI / claudette
  Claudette is Claude's friend
  ☆290Updated this week
• parlance-labs / mcp-llms.txt
  Minimal example of MCP for parsing llms.txt
  ☆40Updated 7 months ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆105Updated last month
• jxnl / blog
  ☆172Updated 2 weeks ago
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 7 months ago
• JeezAI / DSPy_matchmaking
  A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…
  ☆59Updated last year
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆102Updated last year
• AnswerDotAI / toolslm
  Tools to make language models a bit easier to use
  ☆57Updated last month
• SpellcraftAI / oaib
  Use the OpenAI Batch tool to make async batch requests to the OpenAI API.
  ☆100Updated last year
• teknium1 / transformers-gptq-quant
  ☆45Updated 2 years ago
• jxnl / instructor-classify
  ☆36Updated 6 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• yoheinakajima / jsondr
  converts url content into JSON with a simple prefix
  ☆71Updated last year
• jlewi / foyle
  Foyle is a copilot to help developers deploy and operate their applications.
  ☆133Updated 7 months ago