A framework for few-shot evaluation of autoregressive language models.
☆13Jul 14, 2025Updated last year
Alternatives and similar repositories for lm-evaluation-harness
Users that are interested in lm-evaluation-harness are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆10Jul 6, 2023Updated 3 years ago
- Code for publications related to longitudinal dialog research.☆11May 23, 2019Updated 7 years ago
- ☆18Sep 10, 2025Updated last year
- CITETRACER: Cascading Multi-Agent for Citation Hallucination Detection☆14Oct 26, 2026Updated last week
- Official repository for the EMNLP 2019 paper, "Learning Invariant Representations of Social Media Users."☆12Aug 27, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆13Apr 21, 2023Updated 3 years ago
- Learning graph embedding using DeepWalk or Node2Vec☆15Jan 3, 2017Updated 9 years ago
- A barebones set of utilities that help run few-shot prompting using hf☆10Jul 1, 2026Updated 4 months ago
- This repository contains the supplementary materials for the "More than Carbon : Cradle-to-Grave environmental impacts of GenAI training …☆14Feb 26, 2026Updated 8 months ago
- Initiating a paradigm shift in reporting and helping with making ML advances more considerate of sustainability and trustworthiness.☆12Jun 9, 2026Updated 4 months ago
- Interactive tree visualizations for your Home Assistant entity hierarchy.☆13Sep 28, 2026Updated last month
- Identifying Visible Actions in Lifestyle Vlogs☆15Aug 3, 2023Updated 3 years ago
- AI Assistant for Berlin's Public Administration☆34Updated this week
- ☆14Jan 2, 2026Updated 10 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code and data for the paper ”Counting the Bugs in ChatGPT's Wugs: A Multilingual Investigation into the Morphological Capabilities of a L…☆10Dec 3, 2023Updated 2 years ago
- ☆14Sep 30, 2022Updated 4 years ago
- A deep learning utility for comic book covers☆10Oct 7, 2022Updated 4 years ago
- Web app to provide guidance on activity risk levels during the COVID-19 pandemic☆14Feb 18, 2025Updated last year
- ☆12Dec 8, 2022Updated 3 years ago
- Code and data for "Detecting Stance in Media on Global Warming".☆15Dec 8, 2022Updated 3 years ago
- An Actions-Per-Minute Tracker (APM) to provide insights into your APM while you play☆14May 20, 2024Updated 2 years ago
- Engine-Agnostic Model Hot-Swapping for Cost-Effective LLM Inference☆15Nov 13, 2025Updated 11 months ago
- TRAM: Benchmarking Temporal Reasoning for Large Language Models (Findings of ACL 2024)☆27Jun 21, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Adelie: GNU/Linux Terminal Assistant☆10Aug 10, 2021Updated 5 years ago
- Geolocation Inference for Reddit☆14Jun 17, 2024Updated 2 years ago
- A benchmark to evaluate search-augmented LLMs☆17Aug 28, 2025Updated last year
- Supplementary material for our paper "Compute Trends Across Three Eras of Machine Learning".☆48Mar 12, 2022Updated 4 years ago
- Proximal Policy Optimization(PPO) with Keras Implementation☆17Aug 8, 2020Updated 6 years ago
- This repository contains the code for the publication "Harnessing the Power of Multi-Task Pretraining for Ground-Truth Level Natural Lang…☆10Oct 26, 2023Updated 3 years ago
- Retrieval-Enhanced Context-Aware Prefix Encoder for Personalized Dialogue Response Generation☆19Aug 26, 2023Updated 3 years ago
- A Redfish-compatible API server for KubeVirt/OpenShift Virtualization that enables out-of-band management of virtual machines through sta…☆15Oct 23, 2026Updated last week
- 📝 are foundation LMs multilingual knowledge bases? (EMNLP 2023)☆18Dec 8, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 🎓 STiNE CLI / library in Go☆11Apr 3, 2024Updated 2 years ago
- Open transcription platform with scheduled audio processing☆20Updated this week
- ☆15Jul 26, 2023Updated 3 years ago
- Repository of machine learning benchmarks☆51Aug 27, 2026Updated 2 months ago
- Code and data for the paper "Measuring Conversational Uptake: A Case-Study on Student-Teacher Interactions"☆25Apr 24, 2025Updated last year
- Materials "LLMs for science of science research" training, LMU, 2025☆19Feb 28, 2025Updated last year
- An opinionated must-gather analyzer for OpenShift☆12Jun 11, 2026Updated 4 months ago