Alternatives and similar repositories for GermanBenchmark

Users that are interested in GermanBenchmark are comparing it to the libraries listed below

• ZurichNLP / mbr
  Minimum Bayes Risk Decoding for Hugging Face Transformers
  ☆58Updated last year
• bjoernpl / lm-evaluation-harness-de
  A framework for few-shot evaluation of autoregressive language models.
  ☆13Updated last year
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆128Updated 4 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆128Updated last year
• allenai / bff
  ☆38Updated last year
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆59Updated 10 months ago
• melisa-writer / short-transformers
  Prune transformer layers
  ☆69Updated last year
• babylm / evaluation-pipeline-2023
  Evaluation pipeline for the BabyLM Challenge 2023.
  ☆75Updated last year
• evandez / relations
  How do transformer LMs encode relations?
  ☆48Updated last year
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆258Updated 10 months ago
• ARBORproject / arborproject.github.io
  ☆75Updated 3 months ago
• shayne-longpre / a-pretrainers-guide
  ☆72Updated 2 years ago
• SALT-NLP / demonstrated-feedback
  ☆121Updated 8 months ago
• KoyenaPal / future-lens
  Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State
  ☆18Updated last year
• nlp-uoregon / Okapi
  Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
  ☆96Updated last year
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆77Updated last year
• TristanThrush / perplexity-correlations
  Simple and scalable tools for data-driven pretraining data selection.
  ☆24Updated 3 months ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago
• ltgoslo / gpt-bert
  Official implementation of "GPT or BERT: why not both?"
  ☆53Updated 2 months ago
• hadasah / btm
  ☆74Updated last year
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆101Updated last year
• LAGoM-NLP / transtokenizer
  ☆45Updated 4 months ago
• huggingface / that_is_good_data
  ☆65Updated last year
• Cohere-Labs-Community / m-rewardbench
  Official Code for M-RᴇᴡᴀʀᴅBᴇɴᴄʜ: Evaluating Reward Models in Multilingual Settings (ACL 2025 Main)
  ☆28Updated 3 weeks ago
• aryamanarora / causalgym
  CausalGym: Benchmarking causal interpretability methods on linguistic tasks
  ☆43Updated 6 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆86Updated 8 months ago
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆75Updated 9 months ago
• Leukas / CUTE
  ☆13Updated 2 weeks ago
• IBM / benchbench
  A package dedicated for running benchmark agreement testing
  ☆16Updated 3 weeks ago
• amazon-science / llm-interpret
  Code for the ACL 2023 paper: "Rethinking the Role of Scale for In-Context Learning: An Interpretability-based Case Study at 66 Billion Sc…
  ☆30Updated last year