bjoernpl / GermanBenchmark
A repository containing the code for translating popular LLM benchmarks to German.
☆25Updated last year
Alternatives and similar repositories for GermanBenchmark:
Users that are interested in GermanBenchmark are comparing it to the libraries listed below
- Minimum Bayes Risk Decoding for Hugging Face Transformers☆56Updated 8 months ago
- Code for Zero-Shot Tokenizer Transfer☆120Updated last month
- A framework for few-shot evaluation of autoregressive language models.☆13Updated last year
- ☆72Updated 9 months ago
- ☆38Updated 9 months ago
- Evaluation pipeline for the BabyLM Challenge 2023.☆75Updated last year
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆125Updated 11 months ago
- Prune transformer layers☆67Updated 8 months ago
- Code repository for the c-BTM paper☆105Updated last year
- ☆73Updated last year
- CausalGym: Benchmarking causal interpretability methods on linguistic tasks☆40Updated 2 months ago
- ☆116Updated 4 months ago
- The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"☆108Updated last year
- Erasing concepts from neural representations with provable guarantees☆222Updated 2 weeks ago
- Evaluating LLMs with fewer examples☆145Updated 10 months ago
- ☆51Updated 8 months ago
- PyTorch library for Active Fine-Tuning☆54Updated 2 weeks ago
- A package dedicated for running benchmark agreement testing☆16Updated 2 months ago
- Official implementation of "GPT or BERT: why not both?"☆46Updated 2 weeks ago
- Official Code for M-RᴇᴡᴀʀᴅBᴇɴᴄʜ: Evaluating Reward Models in Multilingual Settings☆24Updated 2 weeks ago
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆67Updated 2 months ago
- ☆67Updated 6 months ago
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆175Updated last month
- Inspecting and Editing Knowledge Representations in Language Models☆112Updated last year
- Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".☆65Updated 11 months ago
- Experiments for efforts to train a new and improved t5☆77Updated 10 months ago
- Baby's CoThought: Leveraging LLMs for Enhanced Reasoning in Compact Models☆17Updated last month
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆80Updated 11 months ago
- Discovering Data-driven Hypotheses in the Wild☆54Updated 2 months ago