A framework for few-shot evaluation of language models.
☆37Oct 14, 2026Updated last month
Alternatives and similar repositories for lm-evaluation-harness
Users that are interested in lm-evaluation-harness are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Automatically derive Python dunder methods for your Rust code☆25Sep 24, 2026Updated last month
- ☆26Updated this week
- ☆15Sep 23, 2026Updated last month
- the datasets of our paper☆11Feb 26, 2024Updated 2 years ago
- Large Language Model Text Generation Inference on Habana Gaudi☆34Mar 20, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Whole-cell modeling tutorials☆18Jun 26, 2020Updated 6 years ago
- ☆16Jul 23, 2024Updated 2 years ago
- ☆13Sep 9, 2026Updated 2 months ago
- Code for experiments on self-prediction as a way to measure introspection in LLMs☆16Dec 10, 2024Updated last year
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆98Oct 5, 2026Updated last month
- AI Safety Graph☆18Mar 20, 2025Updated last year
- The official Ruby API for Scale AI, the data platform for AI.☆10Apr 10, 2020Updated 6 years ago
- Testing the accelerate megatron integration☆10Nov 8, 2022Updated 4 years ago
- Gets an auth token for a repo via a GitHub app installation☆16Nov 1, 2026Updated 2 weeks ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A huge dataset for Document Visual Question Answering☆24Jul 29, 2024Updated 2 years ago
- ☆11Oct 15, 2020Updated 6 years ago
- learn mojo☆10May 6, 2026Updated 6 months ago
- The official code repo and data hub of top_nsigma sampling strategy for LLMs.☆29Feb 11, 2025Updated last year
- Automatically check repositories health and quality and build reports that help us understand the current state of Sauce Labs repositorie…☆13Apr 10, 2023Updated 3 years ago
- Sample Callback Server written in Node☆12Sep 22, 2018Updated 8 years ago
- Git worktree lifecycle manager — ticket to PR in one command. Jira, GitHub Issues & GitLab integration. Parallel AI agent workflows, CI m…☆16Sep 19, 2026Updated 2 months ago
- ☆11Jun 29, 2022Updated 4 years ago
- 随机扒取古诗文词语作为git的commit msg☆11Jan 16, 2017Updated 9 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The official Node SDK for Scale AI, the data platform for AI☆16Jan 10, 2024Updated 2 years ago
- ☆12Jun 10, 2024Updated 2 years ago
- Slides for the tutorial talk on Bayesian Machine Learning at PyCon 2017☆10May 19, 2017Updated 9 years ago
- Code for reproducing our paper: LMSOC: An Approach for Socially Sensitive Pretraining☆13Oct 22, 2021Updated 5 years ago
- 🐳 Docker CI image for Leon projects.☆13Nov 6, 2021Updated 5 years ago
- Codes for accepted paper "Cooperative Pruning in Cross-Domain Deep Neural Network Compression" in IJCAI 2019.☆12Aug 15, 2019Updated 7 years ago
- ☆13Feb 13, 2021Updated 5 years ago
- Deep Generative Models (Chainer)☆10Oct 12, 2017Updated 9 years ago
- Terminal-Lego: What Makes Interaction Trajectories Effective for Training Terminal Agents?☆13Jun 4, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Documentation for Pkl packages☆19Updated this week
- Official implementation of "Fourier Compressor: Frequency-Domain Visual Token Compression for Vision-Language Models". (ECCV 2026 Spotlig…☆13Jul 3, 2026Updated 4 months ago
- [FSE'26] Agent-centric Debugging Interface (ADI)☆19Jun 3, 2026Updated 5 months ago
- 🤖 Code for our EMNLP 2022 paper: "BotsTalk: Machine-sourced Framework for Automatic Curation of Large-scale Multi-skill Dialogue Dataset…☆16Oct 7, 2024Updated 2 years ago
- MXFP4-compatible 4-bit floating point types and block formats for Rust.☆12Mar 4, 2026Updated 8 months ago
- Electron's PR monitoring bot☆21Nov 3, 2026Updated 2 weeks ago
- Telegram Mini Apps application template using @telegram-apps/sdk and JavaScript.☆15Jan 7, 2025Updated last year
Are these results useful?