Alternatives and similar repositories for ccai

Users that are interested in ccai are comparing it to the libraries listed below

• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated last year
• GoodAI / goodai-ltm-benchmark
  A library for benchmarking the Long Term Memory and Continual learning capabilities of LLM based agents. With all the tests and code you…
  ☆83Updated last year
• stunningpixels / lou-eval
  Track the progress of LLM context utilisation
  ☆55Updated 9 months ago
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆69Updated last year
• google / sycophancy-intervention
  Scripts for generating synthetic finetuning data for reducing sycophancy.
  ☆121Updated 2 years ago
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆119Updated 9 months ago
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆94Updated last year
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆112Updated last year
• TheDuckAI / DuckTrack
  Multimodal computer agent data collection program
  ☆161Updated 2 months ago
• Alex-Gurung / ReasoningNCP
  Official repo for Learning to Reason for Long-Form Story Generation
  ☆74Updated 9 months ago
• MurtyShikhar / NNetnav
  Interaction-first method for generating demonstrations for web-agents on any website
  ☆51Updated 9 months ago
• allenai / infinigram-api
  ☆93Updated last month
• InflectionAI / Inflection-Benchmarks
  Public Inflection Benchmarks
  ☆68Updated last year
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆199Updated last week
• bethgelab / CiteME
  CiteME is a benchmark designed to test the abilities of language models in finding papers that are cited in scientific texts.
  ☆48Updated 3 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆169Updated last year
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆189Updated 11 months ago
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆153Updated last year
• awslabs / extending-the-context-length-of-open-source-llms
  ☆56Updated 7 months ago
• asappresearch / webagents-step
  ☆41Updated last year
• facebookresearch / ExploreToM
  Code for ExploreTom
  ☆90Updated 7 months ago
• swarnaHub / ExplanationIntervention
  [NeurIPS 2023] PyTorch code for Can Language Models Teach? Teacher Explanations Improve Student Performance via Theory of Mind
  ☆66Updated 2 years ago
• JacobPfau / fillerTokens
  ☆74Updated last year
• allenai / clin
  ☆87Updated 2 years ago
• scottlogic-alex / prm800k-denorm
  Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format
  ☆27Updated 2 years ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆112Updated 9 months ago
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆57Updated last year
• rhyang2021 / SELFGOAL
  Source code for our paper: "SelfGoal: Your Language Agents Already Know How to Achieve High-level Goals".
  ☆69Updated last year
• aymeric-roucher / LongContext_vs_RAG_NeedleInAHaystack
  Comparing retrieval abilities from GPT4-Turbo and a RAG system on a toy example for various context lengths
  ☆35Updated 2 years ago