Alternatives and similar repositories for cot-eval

Users that are interested in cot-eval are comparing it to the libraries listed below

• penfever / wildchat-50m
  Code, results and other artifacts from the paper introducing the WildChat-50m dataset and the Re-Wild model family.
  ☆31Updated 8 months ago
• da03 / WildVisualizer
  ☆25Updated last month
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated 2 years ago
• arcee-ai / DAM
  ☆55Updated last year
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆111Updated last year
• choosewhatulike / case2code
  ☆17Updated 8 months ago
• DunZhang / Stella
  ☆62Updated last year
• LLM360 / Analysis360
  Open Implementations of LLM Analyses
  ☆108Updated last year
• trapoom555 / Language-Model-STS-CFT
  Improving Text Embedding of Language Models Using Contrastive Fine-tuning
  ☆66Updated last year
• HishamAlyahya / semantic_backprop
  Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖
  ☆76Updated last year
• ctlllll / understanding_llm_benchmarks
  Understanding the correlation between different LLM benchmarks
  ☆29Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆53Updated 10 months ago
• jina-ai / jina-vdr
  Jina VDR is a multilingual, multi-domain benchmark for visual document retrieval
  ☆37Updated 4 months ago
• facebookresearch / DIG-In
  This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.
  ☆20Updated last year
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆34Updated 8 months ago
• ArmelRandy / tree-of-problems
  [EMNLP 2024] Tree of Problems: Improving structured problem solving with compositionality
  ☆19Updated 9 months ago
• nec-research / agentquest
  ☆28Updated 8 months ago
• sunblaze-ucb / reasoning_ladder
  ☆35Updated 7 months ago
• leap-laboratories / PIZZA
  An attribution library for LLMs
  ☆46Updated last year
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆30Updated last year
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆102Updated last year
• ASTRAL-Group / LoRe
  When Reasoning Meets Its Laws
  ☆23Updated last week
• patronus-ai / Lynx-hallucination-detection
  ☆43Updated last year
• dinobby / MAGDi
  The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…
  ☆38Updated last year
• srush / LLM-Talk
  ☆53Updated last year
• tigerchen52 / awesome_role_of_small_models
  a curated list of the role of small models in the LLM era
  ☆111Updated last year
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 10 months ago
• kilian-group / phantom-wiki
  Python package for generating datasets to evaluate reasoning and retrieval of large language models
  ☆18Updated 3 months ago
• JHU-CLSP / mmBERT
  A massively multilingual modern encoder language model
  ☆117Updated 2 months ago
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆39Updated 10 months ago