Alternatives and similar repositories for llm-evals

Users that are interested in llm-evals are comparing it to the libraries listed below

• ilya-aby / llm-codenames
  Implementation of the board game Codenames, re-imagined as a collaborative game between LLM agents
  ☆106Updated 8 months ago
• MaximeRivest / attachments
  Easiest way to give context to LLMs; Attachments has the ambition to be the general funnel for any files to be transformed into images+te…
  ☆318Updated last month
• AnswerDotAI / shell_sage
  ShellSage saves sysadmins’ sanity by solving shell script snafus super swiftly
  ☆373Updated this week
• pig-dot-dev / piglet
  ☆142Updated 8 months ago
• em-llm / EM-LLM-model
  ☆234Updated 7 months ago
• nuwandavek / karpathify
  ☆92Updated last year
• agentsea / robbie-g2
  ☆106Updated 9 months ago
• pixeltable / pixelagent
  Pixelagent — Multimodal stateful agents
  ☆220Updated 4 months ago
• aavetis / PRarena
  This repo tracks the opened and merged PRs by the top SWE coding agents by OpenAI, GitHub, and others. Updates every 3 hours.
  ☆292Updated this week
• jxnl / blog
  ☆172Updated last week
• deepsilicon / Sila
  ☆89Updated last year
• Royaltyprogram / Crux
  The State Of The Art, intelligence
  ☆154Updated 2 months ago
• fsndzomga / metadspy
  Metadspy: The framework for specifying—not programming—language models
  ☆88Updated 4 months ago
• MinishLab / vicinity
  Lightweight Nearest Neighbors with Flexible Backends
  ☆312Updated last month
• andyk / headlong
  A framework for collecting a large human-sourced chain-of-thoughts dataset
  ☆23Updated last year
• Ziems / arbor
  A framework for optimizing DSPy programs with RL
  ☆214Updated this week
• AnswerDotAI / claudette
  Claudette is Claude's friend
  ☆286Updated 2 weeks ago
• jxmorris12 / embzip
  lossily compress representation vectors using product quantization
  ☆59Updated last week
• ai8hyf / OpenResearchAssistant
  An automated tool for discovering insights from research papaer corpora
  ☆138Updated last year
• MaximeRivest / functai
  ☆81Updated 2 months ago
• willccbb / claude-deep-research
  Claude Deep Research config for Claude Code.
  ☆223Updated 7 months ago
• irthomasthomas / llm-consortium
  Parallel Reasoning: llm-consortium orchestrates mulitple LLMs, iteratively refines & achieves consensus.
  ☆368Updated last week
• SRSWTI / axis
  AI eXplainable Inference & Search. Open Sourcing on-premise, ultra-fast latency intelligence to all.
  ☆35Updated 8 months ago
• evalops / dspy-micro-agent
  Minimal agent runtime built with DSPy modules and a thin Python loop. Includes CLI, FastAPI server, and eval harness with OpenAI/Ollama s…
  ☆63Updated last month
• parlance-labs / mcp-llms.txt
  Minimal example of MCP for parsing llms.txt
  ☆40Updated 6 months ago
• AI-Hypercomputer / RecML
  ☆211Updated this week
• sumo43 / loopvlm
  run paligemma in real time
  ☆133Updated last year
• groq / openbench
  Provider-agnostic, open-source evaluation infrastructure for language models
  ☆641Updated this week
• BenCaunt / MoondreamObjectTracking
  Using the moondream VLM with optical flow for promptable object tracking
  ☆71Updated 8 months ago
• tanchongmin / agentjo
  Towards Human-Friendly, Fast Learning and Adaptable Agent Communities
  ☆153Updated 3 months ago