Alternatives and similar repositories for cot-eval

Users that are interested in cot-eval are comparing it to the libraries listed below

• OSU-NLP-Group / In-Context-Reranking
  [ICLR'25] "Attention in Large Language Models Yields Efficient Zero-Shot Re-Rankers"
  ☆23Updated 2 months ago
• nlp-uoregon / ullme
  ☆20Updated 2 months ago
• illuin-tech / contextual-embeddings
  Model implementation for the contextual embeddings project
  ☆33Updated 3 weeks ago
• choosewhatulike / case2code
  ☆15Updated 2 months ago
• facebookresearch / ToolVerifier
  This repository contains the ToolSelect dataset which was used to fine-tune Llama-2 70B for tool selection.
  ☆20Updated last year
• DAMO-NLP-SG / CaRing
  Neuro-Symbolic Integration Brings Causal and Reliable Reasoning Proofs
  ☆36Updated last year
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated last year
• allenai / CommaQA
  Code and Dataset for Learning to Solve Complex Tasks by Talking to Agents
  ☆24Updated 3 years ago
• likenneth / persona_drift
  Measuring and Controlling Persona Drift in Language Model Dialogs
  ☆17Updated last year
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆27Updated 5 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆18Updated 5 months ago
• anyscale / long-context-fine-tuning-blogpost
  ☆17Updated last year
• xxxiaol / QRData
  Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data
  ☆38Updated 4 months ago
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆60Updated 2 months ago
• plastic-labs / dspy-opentom
  Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset
  ☆16Updated last year
• guidance-ai / jsonschemabench
  ☆41Updated 2 weeks ago
• kyegomez / Reka-Torch
  Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch
  ☆30Updated this week
• prateeky2806 / ComPEFT
  ☆25Updated last year
• allenai / recoma
  Reasoning by Communicating with Agents
  ☆29Updated last month
• kilian-group / phantom-wiki
  Python package for generating datasets to evaluate reasoning and retrieval of large language models
  ☆18Updated this week
• stanfordnlp / multi-distribution-retrieval
  Code for our paper Resources and Evaluations for Multi-Distribution Dense Information Retrieval
  ☆14Updated last year
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• JHU-CLSP / RATIONALYST
  Code for RATIONALYST: Pre-training Process-Supervision for Improving Reasoning https://arxiv.org/pdf/2410.01044
  ☆33Updated 8 months ago
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• castorini / hf-spacerini
  Plug-and-play Search Interfaces with Pyserini and Hugging Face
  ☆32Updated last year
• awslabs / rag-qa-arena
  ☆45Updated 10 months ago
• da03 / WildVisualizer
  ☆22Updated this week
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆58Updated last month
• axolotl-ai-cloud / grpo_code
  A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.
  ☆30Updated 2 months ago
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆40Updated 3 months ago