Alternatives and similar repositories for evals:

Users that are interested in evals are comparing it to the libraries listed below

• instructor-ai / cloud
  Annoucing Instructor Cloud
  ☆34Updated 7 months ago
• eugeneyan / align-app
  ☆66Updated 5 months ago
• BBischof / yapping
  Verbosity control for AI agents
  ☆61Updated 10 months ago
• AnswerDotAI / web2md-ext
  Get a markdown version of any webpage with a keyboard shortcut.
  ☆62Updated last month
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• JeezAI / DSPy_matchmaking
  A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…
  ☆59Updated 11 months ago
• hamelsmu / claudesave
  A Chrome extension that saves conversations with Claude to GitHubGists or your clipboard.
  ☆80Updated 4 months ago
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆37Updated 8 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated 10 months ago
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated last week
• CyrusNuevoDia / llegos
  A strongly typed Python DSL for developing message passing multi agent systems
  ☆52Updated last year
• eugeneyan / visualizing-finetunes
  ☆78Updated 10 months ago
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆100Updated last year
• AnswerDotAI / web2md
  Convert a web page to markdown
  ☆69Updated 7 months ago
• yoheinakajima / autofinetune
  auto fine tune of models with synthetic data
  ☆75Updated last year
• yoheinakajima / jsondr
  converts url content into JSON with a simple prefix
  ☆67Updated 11 months ago
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆47Updated last year
• ivanleomk / kura
  Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…
  ☆97Updated this week
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• simonw / language-models-on-the-command-line
  Handout for a talk I gave about LLM and CLI tools
  ☆62Updated 10 months ago
• jjallaire / inspect-llm-workshop
  ☆51Updated 10 months ago
• parlance-labs / langfree
  Leverage your LangChain trace data for fine tuning
  ☆41Updated 8 months ago
• braintrustdata / braintrust-cookbook
  ☆28Updated 3 weeks ago
• yoheinakajima / quick_email_scripts
  A couple scripts to grab stats from email
  ☆42Updated 7 months ago
• swyxio / openlangmem
  ☆47Updated last year
• jmanhype / dspy-self-discover-framework
  Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…
  ☆60Updated 8 months ago
• arihanv / fasthtml-modal
  Deploy a FastHTML app in just a few lines of simple python code on Modal's serverless infra.
  ☆26Updated 7 months ago
• AnswerDotAI / toolslm
  Tools to make language models a bit easier to use
  ☆41Updated this week
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆37Updated last year
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆139Updated 6 months ago