Alternatives and similar repositories for lm-evaluation-harness:

Users that are interested in lm-evaluation-harness are comparing it to the libraries listed below

• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆89Updated last year
• kaistAI / Janus
  [NeurIPS 2024] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system messages
  ☆42Updated 2 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆67Updated 4 months ago
• HITsz-TMG / KaLM-Embedding
  Code for KaLM-Embedding models
  ☆71Updated last month
• Digitous / LLM-SLERP-Merge
  Spherical Merge Pytorch/HF format Language Models with minimal feature loss.
  ☆115Updated last year
• LAGoM-NLP / transtokenizer
  ☆41Updated 3 weeks ago
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆76Updated last year
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated 11 months ago
• kaistAI / LangBridge
  [ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervision
  ☆84Updated 3 months ago
• jakespringer / echo-embeddings
  ☆140Updated 10 months ago
• orionw / FollowIR
  FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
  ☆42Updated 7 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆74Updated 5 months ago
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆135Updated 3 months ago
• qhjqhj00 / WebBrain
  ☆69Updated last year
• mungg / FABLES
  ☆57Updated 4 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆57Updated 11 months ago
• cognitivecomputations / spectrum
  ☆113Updated 4 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆125Updated 11 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆120Updated last month
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆46Updated last year
• SALT-NLP / demonstrated-feedback
  ☆117Updated 4 months ago
• swj0419 / detect-pretrain-code-contamination
  ☆74Updated last year
• hyintell / RetrievalQA
  Source code of the paper: RetrievalQA: Assessing Adaptive Retrieval-Augmented Generation for Short-form Open-Domain Question Answering [F…
  ☆62Updated 8 months ago
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆83Updated 6 months ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆203Updated 3 months ago
• neulab / ragged
  Retrieval Augmented Generation Generalized Evaluation Dataset
  ☆51Updated 3 months ago
• patronus-ai / Lynx-hallucination-detection
  ☆32Updated 7 months ago
• abhika-m / FAVA
  ☆66Updated last year
• mukhal / PromptRank
  [ACL 2023] Few-shot Reranking for Multi-hop QA via Language Model Prompting
  ☆27Updated last year
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆69Updated 2 months ago