Alternatives and similar repositories for evals:

Users that are interested in evals are comparing it to the libraries listed below

• eugeneyan / align-app
  ☆67Updated 5 months ago
• jxnl / instructor-classify
  ☆31Updated last week
• BBischof / yapping
  Verbosity control for AI agents
  ☆63Updated 11 months ago
• instructor-ai / cloud
  Annoucing Instructor Cloud
  ☆36Updated 8 months ago
• hamelsmu / claudesave
  A Chrome extension that saves conversations with Claude to GitHubGists or your clipboard.
  ☆85Updated 5 months ago
• AnswerDotAI / web2md-ext
  Get a markdown version of any webpage with a keyboard shortcut.
  ☆63Updated 2 months ago
• yoheinakajima / jsondr
  converts url content into JSON with a simple prefix
  ☆68Updated 11 months ago
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated last month
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• Arbaaz-Mahmood / cognosis-II
  ☆4Updated 8 months ago
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆100Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆47Updated last year
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆37Updated 9 months ago
• JeezAI / DSPy_matchmaking
  A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…
  ☆59Updated last year
• parlance-labs / langfree
  Leverage your LangChain trace data for fine tuning
  ☆41Updated 9 months ago
• AnswerDotAI / web2md
  Convert a web page to markdown
  ☆70Updated 8 months ago
• parlance-labs / mcp-llms.txt
  Minimal example of MCP for parsing llms.txt
  ☆37Updated 3 weeks ago
• jmanhype / dspy-self-discover-framework
  Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…
  ☆60Updated 9 months ago
• braintrustdata / braintrust-cookbook
  ☆30Updated last month
• yoheinakajima / autofinetune
  auto fine tune of models with synthetic data
  ☆75Updated last year
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated 11 months ago
• eugeneyan / visualizing-finetunes
  ☆78Updated 11 months ago
• jacoblee93 / oss-model-extraction-evals
  ☆32Updated last year
• villagecomputing / superopenai
  Logging and caching superpowers for the openai sdk
  ☆105Updated last year
• AnswerDotAI / GeminiSave
  ☆47Updated 3 weeks ago
• jlewi / foyle
  Foyle is a copilot to help developers deploy and operate their applications.
  ☆127Updated last month
• parlance-labs / applied-llms
  Website for Applied-LLMs work
  ☆26Updated 2 weeks ago
• swyxio / openlangmem
  ☆47Updated last year
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆99Updated last year
• teknium1 / transformers-gptq-quant
  ☆48Updated last year