Alternatives and similar repositories for evals:

Users that are interested in evals are comparing it to the libraries listed below

• xlang-ai / batch-prompting
  [EMNLP 2023 Industry Track] A simple prompting approach that enables the LLMs to run inference in batches.
  ☆72Updated last year
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated last year
• allenai / sso
  Repository for Skill Set Optimization
  ☆12Updated 9 months ago
• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆57Updated last year
• FreedomIntelligence / GPT-API-Accelerate
  The "GPT-API-Accelerate" project provides a set of Python classes for accelerating the process of generating responses to prompts using t…
  ☆23Updated 6 months ago
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆23Updated last week
• prateeky2806 / ComPEFT
  ☆25Updated last year
• sunyt32 / torchscale
  Transformers at any scale
  ☆41Updated last year
• kernelmachine / silo-lm
  SILO Language Models code repository
  ☆81Updated last year
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• allenai / cached_path
  A file utility for accessing both local and remote files through a unified interface.
  ☆41Updated 3 weeks ago
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆27Updated 7 months ago
• csinva / iprompt
  Finding semantically meaningful and accurate prompts.
  ☆46Updated last year
• liujch1998 / infini-gram
  ☆37Updated this week
• lucidrains / memory-editable-transformer
  My explorations into editing the knowledge and memories of an attention network
  ☆34Updated 2 years ago
• vicgalle / zero-shot-reward-models
  ZYN: Zero-Shot Reward Models with Yes-No Questions
  ☆33Updated last year
• ruiqi-zhong / D5
  The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions
  ☆69Updated 2 years ago
• petezh / OpenD5
  Tasks for describing differences between text distributions.
  ☆16Updated 9 months ago
• davisyoshida / abnormal-floats
  Code for the note "NF4 Isn't Information Theoretically Optimal (and that's Good)
  ☆18Updated last year
• TheDuckAI / arb
  Advanced Reasoning Benchmark Dataset for LLMs
  ☆46Updated last year
• xhan77 / in-context-alignment
  In-Context Alignment: Chat with Vanilla Language Models Before Fine-Tuning
  ☆34Updated last year
• kyegomez / LM-Infinite
  Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆42Updated 5 months ago
• renll / SeqBoat
  [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling
  ☆36Updated last year
• castorini / hf-spacerini
  Plug-and-play Search Interfaces with Pyserini and Hugging Face
  ☆31Updated last year
• pangjh3 / AnLLM
  ☆15Updated 10 months ago
• facebookresearch / worldsense
  WorldSense benchmark for grounded reasoning in language models
  ☆18Updated last year
• facebookresearch / adaptive_scheduling
  Experimental scripts for researching data adaptive learning rate scheduling.
  ☆23Updated last year
• anthropics / DecompositionFaithfulnessPaper
  ☆27Updated last year
• scottlogic-alex / prm800k-denorm
  Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format
  ☆27Updated last year
• The-Inscrutable-X / TACQ
  Official Repository for Task-Circuit Quantization
  ☆19Updated last week