Alternatives and similar repositories for GermanBenchmark:

Users that are interested in GermanBenchmark are comparing it to the libraries listed below

• bjoernpl / lm-evaluation-harness-de
  A framework for few-shot evaluation of autoregressive language models.
  ☆13Updated last year
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆127Updated 3 months ago
• allenai / bff
  ☆38Updated last year
• ZurichNLP / mbr
  Minimum Bayes Risk Decoding for Hugging Face Transformers
  ☆57Updated 10 months ago
• Cohere-Labs-Community / m-rewardbench
  Official Code for M-RᴇᴡᴀʀᴅBᴇɴᴄʜ: Evaluating Reward Models in Multilingual Settings
  ☆27Updated 2 months ago
• hadasah / btm
  ☆72Updated 11 months ago
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆64Updated 2 months ago
• guy-dar / embedding-space
  ☆54Updated last year
• aryamanarora / causalgym
  CausalGym: Benchmarking causal interpretability methods on linguistic tasks
  ☆41Updated 4 months ago
• nostalgebraist / transformer-utils
  Utilities for the HuggingFace transformers library
  ☆67Updated 2 years ago
• evandez / relations
  How do transformer LMs encode relations?
  ☆47Updated last year
• KoyenaPal / future-lens
  Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State
  ☆18Updated last year
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆128Updated last year
• babylm / evaluation-pipeline-2023
  Evaluation pipeline for the BabyLM Challenge 2023.
  ☆75Updated last year
• shayne-longpre / a-pretrainers-guide
  ☆72Updated last year
• melisa-writer / short-transformers
  Prune transformer layers
  ☆68Updated 10 months ago
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆58Updated 8 months ago
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆77Updated last year
• jmerullo / lm_vector_arithmetic
  ☆34Updated last year
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆254Updated 9 months ago
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆63Updated this week
• SALT-NLP / demonstrated-feedback
  ☆120Updated 6 months ago
• tatsu-lab / opinions_qa
  ☆106Updated 11 months ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆115Updated last year
• ltgoslo / gpt-bert
  Official implementation of "GPT or BERT: why not both?"
  ☆52Updated last month
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆180Updated 3 months ago
• huggingface / that_is_good_data
  ☆65Updated last year
• samrawal / llama2_chat_templater
  Wrapper to easily generate the chat template for Llama2
  ☆64Updated last year
• zouharvi / tokenization-scorer
  Simple-to-use scoring function for arbitrarily tokenized texts.
  ☆39Updated 2 months ago
• EleutherAI / semantic-memorization
  ☆44Updated 5 months ago