Alternatives and similar repositories for EvalLM

Users that are interested in EvalLM are comparing it to the libraries listed below

• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆82Updated 4 months ago
• agentsea / surfkit
  A toolkit for building computer use AI agents
  ☆169Updated 3 weeks ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆219Updated last year
• MinorJerry / OpenWebVoyager
  ☆78Updated 8 months ago
• 567-labs / kura
  Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…
  ☆252Updated 3 weeks ago
• jxnl / blog
  ☆148Updated 2 weeks ago
• topoteretes / awesome-ai-memory
  A list of AI memory projects
  ☆176Updated 6 months ago
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆119Updated last year
• 567-labs / systematically-improving-rag
  ☆154Updated last week
• jxnl / n-levels-of-rag
  ☆195Updated last year
• andrewgcodes / repo2prompt
  Turn a Github Repo's contents into a big prompt for long-context models like Claude 3 Opus.
  ☆217Updated 5 months ago
• simbianai / taskgen
  Task-based Agentic Framework using StrictJSON as the core
  ☆454Updated last week
• TheAgentCompany / TheAgentCompany
  An agent benchmark with tasks in a simulated software company.
  ☆494Updated 2 weeks ago
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆85Updated 9 months ago
• ganarajpr / awesome-dspy
  An Awesome list of curated DSPy resources.
  ☆382Updated 5 months ago
• agentic-ai / enact
  A framework for generative software.
  ☆113Updated 2 weeks ago
• NousResearch / Open-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for LLMs (and beyond)
  ☆448Updated 9 months ago
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆254Updated 9 months ago
• Scrapybara / scrapybara-python
  Scrapybara Python SDK
  ☆70Updated last month
• ai8hyf / OpenResearchAssistant
  An automated tool for discovering insights from research papaer corpora
  ☆138Updated last year
• shobrook / saplings
  A library of reasoning algorithms for agents
  ☆257Updated last month
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆258Updated last week
• weaviate / gorilla
  Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.
  ☆132Updated last month
• neuml / annotateai
  📝 Automatically annotate papers using LLMs
  ☆331Updated 3 months ago
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆289Updated last month
• togethercomputer / open_deep_research
  Together Open Deep Research
  ☆321Updated 3 months ago
• cohere-ai / cohere-terrarium
  A simple Python sandbox for helpful LLM data agents
  ☆275Updated last year
• All-Hands-AI / openhands-resolver
  A system that tries to resolve all issues on a github repo with OpenHands.
  ☆110Updated 8 months ago
• BhabhaAI / dataformer
  Solving data for LLMs - Create quality synthetic datasets!
  ☆150Updated 6 months ago
• OpenArchitectAI / open-architect
  Your automated SWE fleet to get your tickets from the Backlog to Prod!
  ☆98Updated last year