Alternatives and similar repositories for evals

Users that are interested in evals are comparing it to the libraries listed below

• eugeneyan / align-app
  ☆85Updated last year
• AnswerDotAI / web2md-ext
  Get a markdown version of any webpage with a keyboard shortcut.
  ☆67Updated 11 months ago
• BBischof / yapping
  Verbosity control for AI agents
  ☆66Updated last year
• AnswerDotAI / web2md
  Convert a web page to markdown
  ☆80Updated last year
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆103Updated 2 years ago
• eugeneyan / visualizing-finetunes
  ☆79Updated last year
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆107Updated 4 months ago
• jxnl / instructor-classify
  ☆37Updated 8 months ago
• MaximeRivest / attachments
  Easiest way to give context to LLMs; Attachments has the ambition to be the general funnel for any files to be transformed into images+te…
  ☆348Updated 4 months ago
• hamelsmu / claudesave
  A Chrome extension that saves conversations with Claude to GitHubGists or your clipboard.
  ☆90Updated last year
• 567-labs / fastllm
  A collection of LLM services you can self host via docker or modal labs to support your applications development
  ☆198Updated last year
• parlance-labs / mcp-llms.txt
  Minimal example of MCP for parsing llms.txt
  ☆40Updated 9 months ago
• jxnl / n-levels-of-rag
  ☆198Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆50Updated last year
• CyrusNuevoDia / llegos
  A strongly typed Python DSL for developing message passing multi agent systems
  ☆53Updated last year
• instructor-ai / cloud
  Annoucing Instructor Cloud
  ☆38Updated last year
• cohere-ai / quick-start-connectors
  This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…
  ☆154Updated last year
• SpellcraftAI / oaib
  Use the OpenAI Batch tool to make async batch requests to the OpenAI API.
  ☆101Updated last year
• yoheinakajima / autofinetune
  auto fine tune of models with synthetic data
  ☆78Updated last year
• parlance-labs / langfree
  Leverage your LangChain trace data for fine tuning
  ☆46Updated last year
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆40Updated last year
• AnswerDotAI / GeminiSave
  ☆54Updated 9 months ago
• teknium1 / transformers-gptq-quant
  ☆45Updated 2 years ago
• AnswerDotAI / fastdata
  ☆161Updated last year
• jjallaire / inspect-llm-workshop
  ☆54Updated last year
• jlewi / foyle
  Foyle is a copilot to help developers deploy and operate their applications.
  ☆133Updated 10 months ago
• jxnl / blog
  ☆176Updated this week
• ai-evals-course / isaac-fasthtml-workshop
  ☆67Updated 5 months ago
• AnswerDotAI / toolslm
  Tools to make language models a bit easier to use
  ☆64Updated last week
• 567-labs / systematically-improving-rag
  ☆214Updated last week