Alternatives and similar repositories for lm-evaluation-harness:

Users that are interested in lm-evaluation-harness are comparing it to the libraries listed below

• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 9 months ago
• iulia-b10 / multilingual-embedding-models
  ☆20Updated last year
• pacman100 / peft-codegen-25
  ☆24Updated last year
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• SebastianBodza / EnsembleForecasting
  Using multiple LLMs for ensemble Forecasting
  ☆16Updated last year
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆52Updated 4 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆59Updated last year
• modal-labs / mistral-finetuning
  ☆32Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆73Updated 5 months ago
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆47Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆40Updated 2 months ago
• sanchit-gandhi / notebooks
  A collection of notebooks for the Hugging Face blog series (https://huggingface.co/blog).
  ☆44Updated 8 months ago
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆167Updated last year
• Doriandarko / OraclesGPT
  ☆11Updated last year
• shadow-penguins / -KissanDial
  ☆1Updated 9 months ago
• S1M0N38 / dspy-arxiv
  Explore the use of DSPy for extracting features from PDFs 🔎
  ☆39Updated last year
• deep-diver / LLM-Pref-Mark-UI
  ☆37Updated last year
• AIAnytime / Zephyr-7B-beta-RAG-Demo
  Zephyr 7B beta RAG Demo inside a Gradio app powered by BGE Embeddings, ChromaDB, and Zephyr 7B Beta LLM.
  ☆34Updated last year
• mickymultani / RAG-with-Cross-Encoder-Reranker
  Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.
  ☆48Updated last year
• l4b4r4b4b4 / AIDocks
  LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT
  ☆27Updated last year
• lancedb / ragged
  ☆19Updated 5 months ago
• mungg / FABLES
  ☆57Updated 6 months ago
• bipul1010 / agents_tutorial
  ☆19Updated 8 months ago
• raphaelmansuy / iteration_of_tought
  Example implementation of Iteration of Tought - Gives a star if you like the project
  ☆40Updated 3 months ago
• shoggoth13 / agents-deconstructed
  ☆57Updated last year
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated 2 months ago
• AIAnytime / Function-Calling-Mistral-7B
  Function Calling Mistral 7B. Learn how to make functions call for open source LLMs.
  ☆48Updated last year
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆91Updated 2 months ago
• aymeric-roucher / LongContext_vs_RAG_NeedleInAHaystack
  Comparing retrieval abilities from GPT4-Turbo and a RAG system on a toy example for various context lengths
  ☆35Updated last year