dmahan93 / lm-evaluation-harness
A framework for few-shot evaluation of autoregressive language models.
☆17Updated last year
Related projects ⓘ
Alternatives and complementary repositories for lm-evaluation-harness
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆48Updated 4 months ago
- ☆24Updated last year
- ☆48Updated last year
- ☆20Updated 9 months ago
- Writing Blog Posts with Generative Feedback Loops!☆43Updated 8 months ago
- Simple examples using Argilla tools to build AI☆42Updated this week
- Using modal.com to process FineWeb-edu data☆19Updated 2 months ago
- Conduct consumer interviews with synthetic focus groups using LLMs and LangChain☆43Updated last year
- ☆30Updated last year
- ☆41Updated 2 weeks ago
- Using multiple LLMs for ensemble Forecasting☆16Updated 10 months ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated last year
- A data-centric AI package for ML/AI. Get the best high-quality data for the best results. Discord: https://discord.gg/t6ADqBKrdZ☆63Updated last year
- Explore the use of DSPy for extracting features from PDFs 🔎☆33Updated 8 months ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆32Updated 6 months ago
- KMD is a collection of conversational exchanges between patients and doctors on various medical topics. It aims to capture the intricaci…☆23Updated last year
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆34Updated last year
- ☆22Updated last year
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.☆28Updated 9 months ago
- ☆24Updated 10 months ago
- OpenMindedChatbot is a Proof Of Concept that leverages the power of Open source Large Language Models (LLM) with Function Calling capabil…☆28Updated 11 months ago
- Set of scripts to finetune LLMs☆36Updated 7 months ago
- Automated testing and benchmarking for code generation agents.☆17Updated last year
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆97Updated 7 months ago
- A collection of notebooks for the Hugging Face blog series (https://huggingface.co/blog).☆43Updated 3 months ago
- Multimodal Chat with Gemini API☆46Updated 10 months ago
- ☆19Updated 3 months ago
- ☆57Updated last year
- Evaluating LLMs with CommonGen-Lite☆85Updated 8 months ago
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆58Updated 7 months ago