Alternatives and similar repositories for lm-evaluation-harness

Users that are interested in lm-evaluation-harness are comparing it to the libraries listed below

• epoch-research / training-cost-trends
  ☆20Updated 3 weeks ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated last year
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated 2 years ago
• luohongyin / EntST
  Entailment self-training
  ☆25Updated 2 years ago
• prateeky2806 / ComPEFT
  ☆26Updated 2 years ago
• arcee-ai / DAM
  ☆55Updated last year
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆77Updated last year
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆62Updated last year
• TheDuckAI / arb
  Advanced Reasoning Benchmark Dataset for LLMs
  ☆47Updated 2 years ago
• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆29Updated last month
• devvrit / matformer
  MatFormer repo
  ☆67Updated last year
• kyegomez / MobileVLM
  Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …
  ☆15Updated last year
• IBM / activated-lora
  Source code for Activated LoRA
  ☆23Updated last month
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆46Updated 2 months ago
• austrian-code-wizard / c3po
  ☆29Updated last week
• graphcore / Gradient-HuggingFace
  Tasks and tutorials using Graphore's IPU with Hugging Face. Originally at https://github.com/gradient-ai/Graphcore-HuggingFace
  ☆16Updated last year
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆20Updated 11 months ago
• uq-project / UQ
  UQ: Assessing Language Models on Unsolved Questions
  ☆29Updated 4 months ago
• zaydzuhri / flame
  Fork of Flame repo for training of some new stuff in development
  ☆19Updated last week
• HazyResearch / embroid
  Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification
  ☆11Updated 2 years ago
• codezakh / DataEnvGym
  A testbed for agents and environments that can automatically improve models through data generation.
  ☆27Updated 10 months ago
• kyegomez / EXA-1
  An EXA-Scale repository of Multi-Modality AI resources from papers and models, to foundational libraries!
  ☆40Updated last year
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆29Updated 2 months ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆32Updated 11 months ago
• LLM360 / Analysis360
  Open Implementations of LLM Analyses
  ☆107Updated last year
• CosineAI / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆15Updated last year
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆38Updated 6 months ago
• anyscale / long-context-fine-tuning-blogpost
  ☆17Updated last year
• minyoungg / LTE
  ☆71Updated last year
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated last year