A framework for few-shot evaluation of language models.
☆37Apr 3, 2026Updated 5 months ago
Alternatives and similar repositories for lm-evaluation-harness
Users that are interested in lm-evaluation-harness are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆24Updated this week
- ☆27Updated this week
- ☆15Updated this week
- Code for experiments on self-prediction as a way to measure introspection in LLMs☆17Dec 10, 2024Updated last year
- ☆13Sep 9, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Enlightener, the cutting-edge Retrieval-Augmented Generation (RAG) system that revolutionizes query responses. By combining the power of …☆13Jul 28, 2025Updated last year
- ☆16Jul 23, 2024Updated 2 years ago
- Large Language Model Text Generation Inference on Habana Gaudi☆34Mar 20, 2025Updated last year
- AI Safety Graph☆18Mar 20, 2025Updated last year
- AI Energy Score: Initiative to establish comparable energy efficiency ratings for AI models.☆42Dec 2, 2025Updated 9 months ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆97Updated this week
- Code for reproducing our paper: LMSOC: An Approach for Socially Sensitive Pretraining☆13Oct 22, 2021Updated 4 years ago
- Gets an auth token for a repo via a GitHub app installation☆16Sep 12, 2026Updated last week
- ☆11Jun 29, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 随机扒取古诗文词语作为git的commit msg☆11Jan 16, 2017Updated 9 years ago
- Sample Callback Server written in Node☆12Sep 22, 2018Updated 7 years ago
- Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data☆25Jul 30, 2024Updated 2 years ago
- Automatically check repositories health and quality and build reports that help us understand the current state of Sauce Labs repositorie…☆13Apr 10, 2023Updated 3 years ago
- The official Node SDK for Scale AI, the data platform for AI☆16Jan 10, 2024Updated 2 years ago
- BERT score for text generation☆12Jan 15, 2025Updated last year
- BIBench：数据分析领域LLM评测基准☆24Mar 2, 2024Updated 2 years ago
- Oobabooga Text-Gen Web UI extension: get web content, add to context☆22Jun 1, 2024Updated 2 years ago
- PyTorch implementation of https://arxiv.org/abs/1711.02536☆12Jan 11, 2018Updated 8 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- 🤖 Code for our EMNLP 2022 paper: "BotsTalk: Machine-sourced Framework for Automatic Curation of Large-scale Multi-skill Dialogue Dataset…☆16Oct 7, 2024Updated last year
- Official implementation of the paper: "A deeper look at depth pruning of LLMs"☆15Jul 24, 2024Updated 2 years ago
- 🐳 Docker CI image for Leon projects.☆13Nov 6, 2021Updated 4 years ago
- Deep Generative Models (Chainer)☆10Oct 12, 2017Updated 8 years ago
- ☆15Jan 21, 2025Updated last year
- ☆15Jan 14, 2026Updated 8 months ago
- Documentation for Pkl packages☆19Aug 10, 2026Updated last month
- MilimoChat: Privacy-first, self-hosted AI chat with customizable personas, context-aware memory, and local analytics. Built on Python/Str…☆14Mar 12, 2025Updated last year
- Electron's PR monitoring bot☆21Sep 12, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Method to improve inference time for BERT. This is an implementation of the paper titled "PoWER-BERT: Accelerating BERT Inference via Pro…☆63Sep 17, 2025Updated last year
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆23Oct 10, 2024Updated last year
- ☆13Nov 30, 2022Updated 3 years ago
- This repository contains the code for the paper 'PARM: Paragraph Aggregation Retrieval Model for Dense Document-to-Document Retrieval' pu…☆41Jan 5, 2022Updated 4 years ago
- Telegram Mini Apps application template using @telegram-apps/sdk and JavaScript.☆15Jan 7, 2025Updated last year
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆17Updated this week
- Offical Repo for Splitting Steepest Descent for Growing Neural Architectures☆13May 12, 2021Updated 5 years ago