Alternatives and similar repositories for evalchemy:

Users that are interested in evalchemy are comparing it to the libraries listed below

• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆164Updated 3 weeks ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆82Updated 3 months ago
• google-deepmind / mishax
  ☆115Updated this week
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆154Updated 2 months ago
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆184Updated 3 months ago
• SALT-NLP / demonstrated-feedback
  ☆115Updated 3 months ago
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆101Updated 7 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆247Updated 6 months ago
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆157Updated this week
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆141Updated 9 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆80Updated 10 months ago
• ServiceNow / TapeAgents
  TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle
  ☆182Updated this week
• cohere-ai / magikarp
  Code for the paper "Fishing for Magikarp"
  ☆139Updated this week
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆253Updated 2 months ago
• natolambert / rlhf-book
  Textbook on reinforcement learning from human feedback
  ☆111Updated this week
• EleutherAI / sae-auto-interp
  ☆135Updated this week
• bespokelabsai / curator
  Synthetic Data curation for post-training and structured data extraction
  ☆316Updated this week
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆75Updated 3 months ago
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆52Updated last week
• TransluceAI / observatory
  A toolkit for describing model features and intervening on those features to steer behavior.
  ☆149Updated 2 months ago
• SWE-Gym / SWE-Gym
  Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym
  ☆202Updated this week
• cognitivecomputations / spectrum
  ☆108Updated 3 months ago
• architsharma97 / dpo-rlaif
  ☆93Updated 6 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆116Updated 5 months ago
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆79Updated 9 months ago
• SalesforceAIResearch / LaTRO
  ☆89Updated this week
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆51Updated last month
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆160Updated this week
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆153Updated 9 months ago
• da03 / Internalize_CoT_Step_by_Step
  ☆135Updated 3 months ago