Alternatives and similar repositories for linguacrawl

Users that are interested in linguacrawl are comparing it to the libraries listed below

• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆33Updated 5 years ago
• mayhewsw / multilingual-data-stats
  Statistics on multilingual datasets
  ☆17Updated 2 years ago
• allenai / pybart
  Converter from UD-trees to BART representation
  ☆36Updated last year
• mayhewsw / pytorch-truecaser
  A simple neural truecaser written in pytorch and allennlp.
  ☆33Updated 11 months ago
• stefan-it / gc4lm
  GC4LM: A Colossal (Biased) language model for German
  ☆13Updated 4 years ago
• MilaNLProc / bertlang
  A web interface to understand language-specific BERT-models
  ☆18Updated last year
• nyu-mll / pretraining-learning-curves
  The repository for the paper "When Do You Need Billions of Words of Pretraining Data?"
  ☆21Updated 4 years ago
• MilaNLProc / language-invariant-properties
  ☆22Updated 3 years ago
• nyu-dl / AMMI-2019-NLP-Part2
  ☆17Updated 2 years ago
• ivanmontero / autobot
  Implementation of the paper 'Sentence Bottleneck Autoencoders from Transformer Language Models'
  ☆17Updated 3 years ago
• facebookresearch / CCQA
  CCQA A New Web-Scale Question Answering Dataset for Model Pre-Training
  ☆32Updated 2 years ago
• yanaiela / num_fh
  numeric fused-head identification and resolution
  ☆33Updated 5 years ago
• spyysalo / wiki-bert-pipeline
  Generate BERT vocabularies and pretraining examples from Wikipedias
  ☆17Updated 5 years ago
• wietsedv / gpt2-recycle
  As good as new. How to successfully recycle English GPT-2 to make models for other languages (ACL Findings 2021)
  ☆48Updated 3 years ago
• WMT-QE-Task / wmt-qe-2023-data
  ☆9Updated last year
• nelson-liu / lexical-semantic-recognition
  ☆17Updated last year
• jwieting / paraphrastic-representations-at-scale
  ☆76Updated 3 years ago
• yanaiela / TNE
  codebase for the Text-based NP Enrichment (TNE) paper
  ☆20Updated last year
• pdufter / staticlama
  ☆13Updated 4 years ago
• lukasgarbas / can-we-tune-together
  Combining encoder-based language models
  ☆11Updated 3 years ago
• LuisaMaerz / KnowMAN
  KnowMAN: Weakly Supervised Multinomial Adversarial Networks
  ☆12Updated 3 years ago
• stephantul / unitoken
  Tokenization across languages. Useful as preprocessing for subword tokenization.
  ☆22Updated 2 years ago
• ltgoslo / simple_elmo_training
  Minimal code to train ELMo models in recent versions of TensorFlow
  ☆14Updated 2 years ago
• UKPLab / linspector
  ☆24Updated 5 years ago
• webis-de / summary-explorer
  Summary Explorer is a tool to visually explore the state-of-the-art in text summarization.
  ☆44Updated last year
• SemEval / SemEval2021
  ☆29Updated 3 years ago
• google-research-datasets / TF-IDF-IIF-top100-wordlists
  These are lists for a variety of languages containing words that are distinctive to each language.
  ☆38Updated 3 years ago
• marian-nmt / sotastream
  A library for data streaming and augmentation
  ☆20Updated 3 weeks ago
• yahshibu / nested-ner-tacl2020-flair
  Implementation of Nested Named Entity Recognition using Flair
  ☆24Updated 3 years ago
• cindyxinyiwang / expand-via-lexicon-based-adaptation
  Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"
  ☆30Updated 3 years ago