Alternatives and similar repositories for evals:

Users that are interested in evals are comparing it to the libraries listed below

• eugeneyan / align-app
  ☆56Updated 2 months ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• BBischof / yapping
  Verbosity control for AI agents
  ☆59Updated 7 months ago
• AnswerDotAI / web2md
  Convert a web page to markdown
  ☆62Updated 4 months ago
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆99Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆46Updated 9 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆98Updated 3 months ago
• 567-labs / systematically-improving-rag
  ☆73Updated this week
• CyrusNuevoDia / llegos
  A strongly typed Python DSL for developing message passing multi agent systems
  ☆50Updated 9 months ago
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆36Updated 5 months ago
• hamelsmu / claudesave
  A Chrome extension that saves conversations with Claude to GitHubGists or your clipboard.
  ☆76Updated last month
• AnswerDotAI / toolslm
  Tools to make language models a bit easier to use
  ☆32Updated last month
• instructor-ai / cloud
  Annoucing Instructor Cloud
  ☆34Updated 5 months ago
• BerriAI / bettertest
  ☆75Updated 11 months ago
• jmanhype / dspy-self-discover-framework
  Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…
  ☆58Updated 6 months ago
• yoheinakajima / jsondr
  converts url content into JSON with a simple prefix
  ☆64Updated 8 months ago
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• AnswerDotAI / web2md-ext
  Get a markdown version of any webpage with a keyboard shortcut.
  ☆53Updated last month
• enjalot / fineweb-modal
  Using modal.com to process FineWeb-edu data
  ☆19Updated last month
• davanstrien / data-for-fine-tuning-llms
  ☆76Updated 7 months ago
• eugeneyan / visualizing-finetunes
  ☆77Updated 7 months ago
• yoheinakajima / autofinetune
  auto fine tune of models with synthetic data
  ☆74Updated 11 months ago
• modal-labs / awesome-modal
  A curated list of amazingly awesome Modal applications, demos, and shiny things. Inspired by awesome-php.
  ☆100Updated last week
• ivanleomk / kura
  Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…
  ☆53Updated this week
• JeezAI / DSPy_matchmaking
  A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…
  ☆59Updated 8 months ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆99Updated 9 months ago
• lancedb / ragged
  ☆18Updated 3 months ago
• Portkey-AI / portkey-python-sdk
  Build reliable, secure, and production-ready AI apps easily.
  ☆55Updated this week