Alternatives and similar repositories for ccai:

Users that are interested in ccai are comparing it to the libraries listed below

• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆47Updated last month
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆82Updated 3 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆117Updated 6 months ago
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆64Updated 7 months ago
• scottlogic-alex / prm800k-denorm
  Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format
  ☆27Updated last year
• allenai / super-benchmark
  ☆40Updated 3 months ago
• Hritikbansal / sparse_feedback
  ☆28Updated last year
• google / sycophancy-intervention
  Scripts for generating synthetic finetuning data for reducing sycophancy.
  ☆108Updated last year
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆141Updated 9 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆53Updated 5 months ago
• Columbia-NLP-Lab / PAPILLON
  Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles
  ☆20Updated last month
• austrian-code-wizard / c3po
  ☆27Updated last month
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆88Updated 10 months ago
• CarperAI / InstructGPT
  For experiments involving instruct gpt. Currently used for documenting open research questions.
  ☆71Updated 2 years ago
• archiki / ADaPT
  Official code for the paper "ADaPT: As-Needed Decomposition and Planning with Language Models"
  ☆74Updated last year
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆100Updated last month
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆40Updated 10 months ago
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆105Updated last year
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆156Updated 3 months ago
• stunningpixels / lou-eval
  Track the progress of LLM context utilisation
  ☆53Updated 6 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆73Updated last month
• msclar / formatspread
  Code accompanying "How I learned to start worrying about prompt formatting".
  ☆100Updated 3 months ago
• reasoning-machines / prompt-lib
  A set of utilities for running few-shot prompting experiments on large-language models
  ☆116Updated last year
• GAIR-NLP / OlympicArena
  This is the official repository of the paper "OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI"
  ☆91Updated last month
• allenai / clin
  ☆81Updated last year
• yueqis / API-Based-Agent
  ☆47Updated 2 months ago
• InflectionAI / Inflection-Benchmarks
  Public Inflection Benchmarks
  ☆69Updated 10 months ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated 11 months ago
• laramohan / wikillm
  LLMs as Collaboratively Edited Knowledge Bases
  ☆43Updated 11 months ago
• aymeric-roucher / LongContext_vs_RAG_NeedleInAHaystack
  Comparing retrieval abilities from GPT4-Turbo and a RAG system on a toy example for various context lengths
  ☆35Updated last year