Alternatives and similar repositories for lm-evaluation-harness:

Users that are interested in lm-evaluation-harness are comparing it to the libraries listed below

• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆48Updated 6 months ago
• pacman100 / peft-codegen-25
  ☆24Updated last year
• SebastianBodza / EnsembleForecasting
  Using multiple LLMs for ensemble Forecasting
  ☆16Updated last year
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• kyegomez / Kosmos-X
  The Next Generation Multi-Modality Superintelligence
  ☆70Updated 4 months ago
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆47Updated 10 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆29Updated 4 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆100Updated 4 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆66Updated 3 months ago
• yoheinakajima / autofinetune
  auto fine tune of models with synthetic data
  ☆74Updated 11 months ago
• hwchase17 / chain-of-verification
  ☆30Updated last year
• explodinggradients / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆34Updated last year
• arcee-ai / DAM
  ☆48Updated 2 months ago
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆69Updated last year
• knowrohit / know_medical_dialogues
  KMD is a collection of conversational exchanges between patients and doctors on various medical topics. It aims to capture the intricaci…
  ☆24Updated last year
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆36Updated 10 months ago
• venuv / LangSynth
  Conduct consumer interviews with synthetic focus groups using LLMs and LangChain
  ☆43Updated last year
• S1M0N38 / dspy-arxiv
  Explore the use of DSPy for extracting features from PDFs 🔎
  ☆38Updated 10 months ago
• shoggoth13 / agents-deconstructed
  ☆57Updated last year
• bipul1010 / agents_tutorial
  ☆19Updated 5 months ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆52Updated 2 months ago
• deep-diver / LLM-Pref-Mark-UI
  ☆37Updated last year
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆88Updated 10 months ago
• cg123 / rathe
  Tools for formatting large language model prompts.
  ☆12Updated last year
• stunningpixels / lou-eval
  Track the progress of LLM context utilisation
  ☆53Updated 6 months ago
• aigeek0x0 / rag-with-langchain-colbert-and-ragatouille
  Build a Streamlit Chatbot using Langchain, ColBERT, Ragatouille, and ChromaDB
  ☆118Updated last year
• CarperAI / treasure_trove
  ☆22Updated last year
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆25Updated last year
• cognitivecomputations / kraken
  ☆65Updated 8 months ago
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought"
  ☆89Updated last week