A framework for few-shot evaluation of autoregressive language models.
☆13Feb 14, 2024Updated 2 years ago
Alternatives and similar repositories for lm-evaluation-harness-de
Users that are interested in lm-evaluation-harness-de are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A repository containing the code for translating popular LLM benchmarks to German.☆32Aug 20, 2023Updated 3 years ago
- ☆17Jul 4, 2025Updated last year
- A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.☆66Jul 29, 2024Updated 2 years ago
- LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT☆28Feb 18, 2024Updated 2 years ago
- ☆17Sep 17, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- implementation of https://arxiv.org/pdf/2312.09299☆21Jul 3, 2024Updated 2 years ago
- German Alpaca Dataset (Cleaned + Translated)☆26Apr 6, 2023Updated 3 years ago
- Python Implementation of a Bengali OCR☆10Jul 20, 2019Updated 7 years ago
- ☆11Oct 14, 2022Updated 3 years ago
- ☆26Apr 10, 2025Updated last year
- A Dropbox filesystem adapter for just-bash.☆16Apr 7, 2026Updated 5 months ago
- Eval LLMs☆11May 12, 2024Updated 2 years ago
- Versatile framework designed to streamline the integration of your models, as well as those sourced from Hugging Face, into complex progr…☆35Aug 21, 2025Updated last year
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16May 8, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- This repository contains the ToolSelect dataset which was used to fine-tune Llama-2 70B for tool selection.☆23Mar 11, 2024Updated 2 years ago
- ☆18Nov 19, 2025Updated 10 months ago
- ☆18Jan 26, 2022Updated 4 years ago
- MTEB: Massive Text Embedding Benchmark☆11Jan 29, 2024Updated 2 years ago
- [ICML 24] A novel automated neuron explanation framework that can accurately describe poly-semantic concepts in deep neural networks☆14May 2, 2025Updated last year
- My website & blog with articles about coding, tech, functional programming, …☆10Sep 10, 2026Updated 2 weeks ago
- Source code used in the blog☆12Feb 6, 2024Updated 2 years ago
- Extendable Scratch3 Programming Environment☆11Aug 5, 2026Updated last month
- No Language Left Unlocked: scalable backtranslation of NLLB models☆13Aug 4, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- alternative remote for Lego Boost with Pythonista and iOS☆10Aug 27, 2017Updated 9 years ago
- ☆16Mar 1, 2026Updated 6 months ago
- PostgreSQL-backed virtual filesystem with a bash interface.☆21Aug 13, 2026Updated last month
- A complete guide to evaluate LLMs and RAGs. Both theory and code based approaches covered.☆27Nov 16, 2023Updated 2 years ago
- Schematics, board layout and BOM☆12May 1, 2019Updated 7 years ago
- NeMo: a toolkit for conversational AI☆16Mar 9, 2023Updated 3 years ago
- C++ inference engine for running GLiNER (Generalist and Lightweight Named Entity Recognition) models☆52Jul 10, 2026Updated 2 months ago
- Repository for the EM German Model☆112Nov 13, 2023Updated 2 years ago
- ☆11Apr 6, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A Python package for extracting confidence scores from LLM models outputs, particularly using log probabilities.☆19Sep 15, 2024Updated 2 years ago
- Cache extension for ASGI frameworks☆18Oct 2, 2024Updated last year
- Official code for paper LIME: Learning Inductive Bias for Primitives of Mathematical Reasoning☆29Jun 11, 2021Updated 5 years ago
- MUCGPT is an assistant-focused AI toolkit aimed at public administration. It includes different modes of interaction and lets users creat…☆58Updated this week
- Simple, fast dictionary-based language detector for short texts.☆21Feb 5, 2026Updated 7 months ago
- Make-like task executor for Unix OS☆17Jul 28, 2026Updated last month
- Fractal clock effect using css, js, and html☆22Aug 16, 2018Updated 8 years ago