dmahan93 / lm-evaluation-harness
A framework for few-shot evaluation of autoregressive language models.
☆17Updated last year
Related projects ⓘ
Alternatives and complementary repositories for lm-evaluation-harness
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆48Updated 4 months ago
- Writing Blog Posts with Generative Feedback Loops!☆42Updated 7 months ago
- ☆20Updated 9 months ago
- ☆48Updated last year
- ☆38Updated this week
- Using modal.com to process FineWeb-edu data☆19Updated 2 months ago
- A collection of notebooks for the Hugging Face blog series (https://huggingface.co/blog).☆42Updated 3 months ago
- LLM reads a paper and produce a working prototype☆33Updated this week
- Simple examples using Argilla tools to build AI☆38Updated this week
- ☆30Updated last year
- ☆24Updated last year
- Conduct consumer interviews with synthetic focus groups using LLMs and LangChain☆43Updated last year
- ☆11Updated last year
- ☆64Updated last year
- OpenMindedChatbot is a Proof Of Concept that leverages the power of Open source Large Language Models (LLM) with Function Calling capabil…☆28Updated 10 months ago
- Explore the use of DSPy for extracting features from PDFs 🔎☆33Updated 8 months ago
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.☆28Updated 8 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆40Updated 8 months ago
- Using multiple LLMs for ensemble Forecasting☆16Updated 9 months ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated last year
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆34Updated last year
- ☆57Updated last year
- Automated testing and benchmarking for code generation agents.☆17Updated last year
- Public reports detailing responses to sets of prompts by Large Language Models.☆25Updated last year
- Cog wrapper for collabora/WhisperSpeech☆24Updated 8 months ago
- ☆41Updated last month
- Tutorial for DSPy☆21Updated 6 months ago
- Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA☆101Updated 3 months ago
- A repository of projects and datasets under active development by Alignment Lab AI☆22Updated 10 months ago
- Set of scripts to finetune LLMs☆36Updated 7 months ago