Alternatives and similar repositories for lm-evaluation-harness

Users that are interested in lm-evaluation-harness are comparing it to the libraries listed below

• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆60Updated 2 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆78Updated 9 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆57Updated 9 months ago
• arcee-ai / DAM
  ☆51Updated 7 months ago
• Nardien / agent-distillation
  Official Code Repository for the paper "Distilling LLM Agent into Small Models with Retrieval and Code Tools"
  ☆104Updated 2 weeks ago
• facebookresearch / ReasonIR
  Official repository for paper "ReasonIR Training Retrievers for Reasoning Tasks".
  ☆170Updated 2 weeks ago
• THUDM / ComplexFuncBench
  Complex Function Calling Benchmark.
  ☆114Updated 5 months ago
• Ayanami0730 / deep_research_bench
  DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents
  ☆82Updated this week
• hyintell / RetrievalQA
  Source code of the paper: RetrievalQA: Assessing Adaptive Retrieval-Augmented Generation for Short-form Open-Domain Question Answering [F…
  ☆66Updated last year
• ytyz1307zzh / RefAug
  Code for EMNLP 2024 paper "Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning"
  ☆54Updated 8 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆77Updated 8 months ago
• allenai / infinigram-api
  ☆60Updated 2 weeks ago
• SALT-NLP / demonstrated-feedback
  ☆123Updated 8 months ago
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆137Updated 7 months ago
• patronus-ai / Lynx-hallucination-detection
  ☆39Updated 11 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆94Updated 3 months ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆223Updated 7 months ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• cognitivecomputations / spectrum
  ☆124Updated 2 months ago
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆73Updated last month
• mungg / FABLES
  ☆57Updated 8 months ago
• writer / writing-in-the-margins
  ☆118Updated 9 months ago
• SalesforceAIResearch / LaTRO
  ☆115Updated 4 months ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆91Updated 2 months ago
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆47Updated 5 months ago
• QwenLM / WorldPM
  ☆86Updated last month
• abhika-m / FAVA
  ☆71Updated last year
• DunZhang / Stella
  ☆62Updated 11 months ago
• TIGER-AI-Lab / CritiqueFineTuning
  Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"
  ☆157Updated 2 weeks ago
• kaistAI / Janus
  [NeurIPS 2024] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system messages
  ☆48Updated 6 months ago