Alternatives and similar repositories for ccai

Users that are interested in ccai are comparing it to the libraries listed below

• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆56Updated 5 months ago
• scottlogic-alex / prm800k-denorm
  Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format
  ☆27Updated last year
• InflectionAI / Inflection-Benchmarks
  Public Inflection Benchmarks
  ☆68Updated last year
• allenai / clin
  ☆82Updated last year
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆90Updated last month
• Columbia-NLP-Lab / PAPILLON
  Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles
  ☆33Updated 3 weeks ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆86Updated 8 months ago
• SWE-bench / sb-cli
  Run SWE-bench evaluations remotely
  ☆17Updated 2 weeks ago
• princeton-pli / hal-harness
  ☆89Updated this week
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 10 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆173Updated 2 months ago
• Alignment-Lab-AI / Our-Projects
  A repository of projects and datasets under active development by Alignment Lab AI
  ☆22Updated last year
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 4 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆155Updated last year
• yueqis / API-Based-Agent
  ☆50Updated this week
• uclaml / Rephrase-and-Respond
  Official repo of Respond-and-Respond: data, code, and evaluation
  ☆103Updated 10 months ago
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆121Updated 11 months ago
• Hritikbansal / sparse_feedback
  ☆29Updated last year
• choosewhatulike / case2code
  ☆15Updated last month
• colonylabs / ScribeAgent
  Code for ScribeAgent paper
  ☆57Updated 3 months ago
• ScalingIntelligence / codemonkeys
  ☆41Updated 4 months ago
• MurtyShikhar / NNetnav
  Interaction-first method for generating demonstrations for web-agents on any website
  ☆41Updated last month
• microsoft / EvoPrompt
  Automatic Prompt Optimization
  ☆36Updated last year
• austrian-code-wizard / c3po
  ☆27Updated this week
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆90Updated last year
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆43Updated last year
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• allenai / hybrid-preferences
  Learning to route instances for Human vs AI Feedback (ACL 2025 Main)
  ☆23Updated 3 weeks ago
• kumar-shridhar / Screws
  SCREWS: A Modular Framework for Reasoning with Revisions
  ☆27Updated last year
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆54Updated last year