Alternatives and similar repositories for lm-evaluation-harness

Users that are interested in lm-evaluation-harness are comparing it to the libraries listed below

• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆30Updated this week
• epoch-research / training-cost-trends
  ☆19Updated 3 weeks ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated last year
• austrian-code-wizard / c3po
  ☆29Updated 3 weeks ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆27Updated 7 months ago
• arcee-ai / DAM
  ☆54Updated 9 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆78Updated last year
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆25Updated 7 months ago
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated last year
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆46Updated last year
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆105Updated 8 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆18Updated 7 months ago
• kumar-shridhar / Screws
  SCREWS: A Modular Framework for Reasoning with Revisions
  ☆27Updated last year
• graphcore / Gradient-HuggingFace
  Tasks and tutorials using Graphore's IPU with Hugging Face. Originally at https://github.com/gradient-ai/Graphcore-HuggingFace
  ☆16Updated last year
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆34Updated last year
• axolotl-ai-cloud / axolotl-cookbook
  ☆34Updated 3 weeks ago
• lilakk / BLEUBERI
  Official repository for "BLEUBERI: BLEU is a surprisingly effective reward for instruction following"
  ☆25Updated 2 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated last year
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 6 months ago
• sher222 / LeReT
  Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval
  ☆49Updated 9 months ago
• edwardmilsom / function-space-learning-rates-paper
  Code for the paper "Function-Space Learning Rates"
  ☆23Updated 2 months ago
• ctlllll / understanding_llm_benchmarks
  Understanding the correlation between different LLM benchmarks
  ☆29Updated last year
• RWKV / ZeroCoT
  https://x.com/BlinkDL_AI/status/1884768989743882276
  ☆28Updated 3 months ago
• kyegomez / MobileVLM
  Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …
  ☆15Updated last year
• GenRobo / MatMamba
  Code and pretrained models for the paper: "MatMamba: A Matryoshka State Space Model"
  ☆61Updated 9 months ago
• CosineAI / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆15Updated 11 months ago
• zaydzuhri / flame
  Fork of Flame repo for training of some new stuff in development
  ☆15Updated last month
• codezakh / DataEnvGym
  A testbed for agents and environments that can automatically improve models through data generation.
  ☆27Updated 5 months ago
• RobertCsordas / moeut
  ☆85Updated last year
• prateeky2806 / ComPEFT
  ☆26Updated last year