Alternatives and similar repositories for evalchemy:

Users that are interested in evalchemy are comparing it to the libraries listed below

• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆195Updated last week
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆231Updated 3 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆259Updated 3 months ago
• huggingface / cosmopedia
  ☆496Updated 2 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆252Updated 7 months ago
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆167Updated last month
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆200Updated 3 months ago
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆197Updated 4 months ago
• sail-sg / oat
  🌾 OAT: A research-friendly framework for LLM online alignment, including preference learning, reinforcement learning, etc.
  ☆182Updated last week
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆158Updated 2 months ago
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆296Updated last year
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆160Updated this week
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆486Updated last month
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆215Updated 3 months ago
• da03 / Internalize_CoT_Step_by_Step
  ☆146Updated last week
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆451Updated 10 months ago
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆347Updated 5 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆145Updated 10 months ago
• NousResearch / Open-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for LLMs (and beyond)
  ☆407Updated 4 months ago
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆270Updated this week
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆172Updated 3 months ago
• vsubramaniam851 / multiagent-ft
  ☆158Updated last month
• SWE-Gym / SWE-Gym
  Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym
  ☆325Updated last month
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆503Updated this week
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆173Updated last month
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆128Updated 3 months ago
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆270Updated 7 months ago
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆239Updated 2 weeks ago
• kohjingyu / search-agents
  Code for the paper 🌳 Tree Search for Language Model Agents
  ☆175Updated 6 months ago