Alternatives and similar repositories for bias-in-german-nlg

Users that are interested in bias-in-german-nlg are comparing it to the libraries listed below

• bigscience-workshop / data_tooling
  Tools for managing datasets for governance and training.
  ☆85Updated 2 months ago
• huggingface / that_is_good_data
  ☆66Updated 2 years ago
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆59Updated last year
• lm-pub-quiz / lm-pub-quiz
  Evaluate language models using multiple choice items
  ☆13Updated 2 months ago
• UniversalNER / UniversalNER
  ☆27Updated 5 months ago
• alexa / ramen
  A software for transferring pre-trained English models to foreign languages
  ☆18Updated 2 years ago
• bigscience-workshop / multilingual-modeling
  BLOOM+1: Adapting BLOOM model to support a new unseen language
  ☆73Updated last year
• sophiaalthammer / parm
  This repository contains the code for the paper 'PARM: Paragraph Aggregation Retrieval Model for Dense Document-to-Document Retrieval' pu…
  ☆41Updated 3 years ago
• ClimSocAna / tecb-de
  German Text Embedding Clustering Benchmark
  ☆17Updated last year
• CPJKU / wechsel
  Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
  ☆82Updated 11 months ago
• gsarti / t5-flax-gcp
  Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP
  ☆58Updated 3 years ago
• UKPLab / acl2024-triple-encoders
  triple-encoders is a library for contextualizing distributed Sentence Transformers representations.
  ☆14Updated 11 months ago
• TurkuNLP / bert-eval
  ☆10Updated 5 years ago
• huggingface / olm-datasets
  Pipeline for pulling and processing online language model pretraining data from the web
  ☆177Updated 2 years ago
• malteos / clp-transfer
  Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning
  ☆30Updated 2 years ago
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆103Updated last year
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆25Updated 8 months ago
• ZurichNLP / mbr
  Minimum Bayes Risk Decoding for Hugging Face Transformers
  ☆58Updated last year
• konstantinjdobler / focus
  [EMNLP'23] Official Code for "FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models"
  ☆32Updated 2 months ago
• bltlab / seqscore
  SeqScore: Scoring for named entity recognition and other sequence labeling tasks
  ☆23Updated 5 months ago
• Babelscape / wikineural
  Data and evaluation code for the paper WikiNEuRal: Combined Neural and Knowledge-based Silver Data Creation for Multilingual NER (EMNLP 2…
  ☆69Updated 2 years ago
• feralvam / easse
  Easier Automatic Sentence Simplification Evaluation
  ☆161Updated last year
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆21Updated 2 years ago
• LEL-A / GerAlpacaDataCleaned
  German Alpaca Dataset (Cleaned + Translated)
  ☆26Updated 2 years ago
• cisnlp / GlotLID
  💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆147Updated 2 months ago
• Mivg / SLED
  The official repository for Efficient Long-Text Understanding Using Short-Text Models (Ivgi et al., 2022) paper
  ☆69Updated 2 years ago
• oscar-project / ungoliant
  The pipeline for the OSCAR corpus
  ☆171Updated last year
• katzurik / NERetrieve
  ☆28Updated last year
• tigerchen52 / GLADIS
  GLADIS: A General and Large Acronym Disambiguation Benchmark (EACL 23)
  ☆17Updated last year
• flipz357 / S3BERT
  Semantically Structured Sentence Embeddings
  ☆67Updated 9 months ago