krangelie / bias-in-german-nlgLinks
Master thesis: Exploring bias in German NLG (GPT-3 & GerPT-2). Applies regard classification and bias mitigation triggers.
☆16Updated last year
Alternatives and similar repositories for bias-in-german-nlg
Users that are interested in bias-in-german-nlg are comparing it to the libraries listed below
Sorting:
- Evaluate language models using multiple choice items☆13Updated 3 months ago
- ☆65Updated 2 years ago
- Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning☆30Updated 2 years ago
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆74Updated last year
- Repository with code for MaChAmp: https://aclanthology.org/2021.eacl-demos.22/☆90Updated 7 months ago
- ☆26Updated 10 months ago
- German Alpaca Dataset (Cleaned + Translated)☆26Updated 2 years ago
- A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.☆64Updated last year
- A software for transferring pre-trained English models to foreign languages☆19Updated 2 years ago
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆189Updated 6 months ago
- Pipeline for pulling and processing online language model pretraining data from the web☆179Updated 2 years ago
- ☆52Updated 2 years ago
- German Text Embedding Clustering Benchmark☆18Updated last year
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆96Updated 2 years ago
- Easier Automatic Sentence Simplification Evaluation☆165Updated 2 years ago
- ☆40Updated last year
- ☆10Updated 6 years ago
- ☆180Updated last year
- Semantically Structured Sentence Embeddings☆69Updated last year
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆107Updated last year
- Data and evaluation code for the paper WikiNEuRal: Combined Neural and Knowledge-based Silver Data Creation for Multilingual NER (EMNLP 2…☆70Updated 2 years ago
- Data for the HIPE 2022 shared task.☆21Updated 2 years ago
- ☆31Updated 2 years ago
- This repository provides the source code used to automatically generate the book summarization datasets described in the paper titled "Ec…☆11Updated 8 months ago
- Tools for managing datasets for governance and training.☆87Updated last month
- ☆16Updated 3 years ago
- Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.☆123Updated 2 months ago
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback☆96Updated 2 years ago
- Find informative examples to efficiently (human)-evaluate NLG models.☆17Updated last month
- Minimum Bayes Risk Decoding for Hugging Face Transformers☆60Updated last year