OpenGPTX / lm-evaluation-harnessView external linksLinks
A framework for few-shot evaluation of autoregressive language models.
☆12Jul 14, 2025Updated 6 months ago
Alternatives and similar repositories for lm-evaluation-harness
Users that are interested in lm-evaluation-harness are comparing it to the libraries listed below
Sorting:
- GPI-Space: Memory Driven Computing and Big Data☆10Jan 2, 2025Updated last year
- Self-evaluating RAG application on LangCheck docs☆11Sep 10, 2025Updated 5 months ago
- ☆10Jul 6, 2023Updated 2 years ago
- Eine Markdown-Version der gemeinfreien Menge-Bibel☆10Nov 2, 2021Updated 4 years ago
- Demo repository showcasing how to use reusable workflows to build artifact attestations☆13Feb 2, 2026Updated last week
- ☆17Sep 10, 2025Updated 5 months ago
- ☆20Updated this week
- IonQ iQuHACK 2024 Remote Challenge☆11Feb 3, 2024Updated 2 years ago
- DOMAINEVAL is an auto-constructed benchmark for multi-domain code generation that consists of 2k+ subjects (i.e., description, reference …☆14Dec 12, 2024Updated last year
- ☆12Jan 11, 2026Updated last month
- A NOMAD plugin containing base sections for material processing.☆11Jan 20, 2026Updated 3 weeks ago
- [CVPR2024] Learning from Synthetic Human Group Activities☆14Feb 24, 2025Updated 11 months ago
- Amplify your coding capabilities with AI - your smart co-pilot for an elevated coding experience.☆14Updated this week
- A Swedish Natural Language Understanding Benchmark☆11Dec 12, 2025Updated 2 months ago
- Paper dataset for "Factored Verification: Detecting and Reducing Hallucination in Summaries of Academic Papers"☆13Oct 20, 2024Updated last year
- PSI-MOD ontology for modified and unmodified amino acid residues☆14Jan 8, 2026Updated last month
- Simple getting started procedure for SciCat☆11Updated this week
- gammcor code☆11Sep 25, 2025Updated 4 months ago
- A Python client library for accessing IQM quantum computers☆13Mar 26, 2025Updated 10 months ago
- Quandela iQuHACK 2024 Remote Challenge☆10Feb 4, 2024Updated 2 years ago
- Dataset for AAAI paper "Natural Language Inference in Context - Investigating Contextual Reasoning over Long Texts"☆11Nov 18, 2022Updated 3 years ago
- ☆12Nov 5, 2024Updated last year
- IBM iQuHACK 2024 In-Person Challenge☆13Feb 6, 2024Updated 2 years ago
- Align, a general text alignment function☆15Dec 7, 2023Updated 2 years ago
- ☆13Nov 28, 2025Updated 2 months ago
- ☆11Jan 3, 2024Updated 2 years ago
- LLM red teaming datasets from the paper 'Student-Teacher Prompting for Red Teaming to Improve Guardrails' for the ART of Safety Workshop …☆22Oct 12, 2023Updated 2 years ago
- Ontology of algorithms for analyzing biological models, their parameters, and their outputs☆11Dec 2, 2024Updated last year
- 中文金融大模型测评基准，六大类二十五任务、等级化评价，国内模型获得A级☆10May 6, 2024Updated last year
- ☆13Aug 23, 2025Updated 5 months ago
- Website for release of TellMeWhy dataset for why question answering☆14Nov 11, 2022Updated 3 years ago
- Spatialyze: A Geospatial Video Analytic System with Spatial-Aware Optimizations☆10Mar 3, 2025Updated 11 months ago
- Python package to infer tensions and pressures from 3D microscopy images of embryos and tissues☆12Nov 4, 2025Updated 3 months ago
- LLM benchmarks☆13Feb 22, 2024Updated last year
- Code for our project CROWN (Conversational Passage Ranking by Reasoning over Word Networks)☆10Jan 11, 2024Updated 2 years ago
- ☆18Jul 3, 2025Updated 7 months ago
- The project represents a Python framework for computing the electron transport characteristics using the non-equilibrium Green's function…☆12May 13, 2019Updated 6 years ago
- Fortran source code analysis tool☆11Nov 11, 2020Updated 5 years ago
- ☆11Oct 15, 2022Updated 3 years ago