Alternatives and similar repositories for linguacrawl:

Users that are interested in linguacrawl are comparing it to the libraries listed below

• spyysalo / wiki-bert-pipeline
  Generate BERT vocabularies and pretraining examples from Wikipedias
  ☆18Updated 4 years ago
• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆33Updated 4 years ago
• mayhewsw / pytorch-truecaser
  A simple neural truecaser written in pytorch and allennlp.
  ☆33Updated 9 months ago
• mayhewsw / multilingual-data-stats
  Statistics on multilingual datasets
  ☆17Updated 2 years ago
• stephantul / unitoken
  Tokenization across languages. Useful as preprocessing for subword tokenization.
  ☆22Updated 2 years ago
• codogogo / towerparse
  Tower Parse: Low-Resource Dependency Parsing via Hierarchical Source Selection
  ☆15Updated 3 years ago
• allenai / pybart
  Converter from UD-trees to BART representation
  ☆36Updated last year
• nelson-liu / lexical-semantic-recognition
  ☆17Updated last year
• yanaiela / num_fh
  numeric fused-head identification and resolution
  ☆33Updated 5 years ago
• ltgoslo / simple_elmo_training
  Minimal code to train ELMo models in recent versions of TensorFlow
  ☆14Updated last year
• ivanmontero / autobot
  Implementation of the paper 'Sentence Bottleneck Autoencoders from Transformer Language Models'
  ☆17Updated 3 years ago
• MilaNLProc / bertlang
  A web interface to understand language-specific BERT-models
  ☆17Updated 11 months ago
• wietsedv / gpt2-recycle
  As good as new. How to successfully recycle English GPT-2 to make models for other languages (ACL Findings 2021)
  ☆48Updated 3 years ago
• marian-nmt / sotastream
  A library for data streaming and augmentation
  ☆20Updated last year
• adapter-hub / hgiyt
  Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"
  ☆26Updated 3 years ago
• google-research-datasets / lareqa
  LAReQA is a challenging benchmark for evaluating language agnostic answer retrieval from a multilingual candidate pool. This repository c…
  ☆14Updated 4 years ago
• apmoore1 / fiesta
  Fast IdEntification of State-of-The-Art models using adaptive bandit algorithms
  ☆14Updated 2 years ago
• SAP / software-documentation-data-set-for-machine-translation
  A parallel evaluation data set of SAP software documentation with document structure annotation
  ☆11Updated 2 weeks ago
• cindyxinyiwang / expand-via-lexicon-based-adaptation
  Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"
  ☆30Updated 3 years ago
• wietsedv / xpos
  Make the Best of Cross-lingual Transfer: Evidence from POS Tagging with over 100 Languages (ACL 2022)
  ☆19Updated 2 years ago
• stefan-it / gc4lm
  GC4LM: A Colossal (Biased) language model for German
  ☆13Updated 3 years ago
• midas-research / bhaav
  Dataset of sentences from Hindi stories tagged with different emotion tags
  ☆10Updated 5 years ago
• machine-intelligence-laboratory / OptimalNumberOfTopics
  A set of methods for finding an appropriate number of topics in a text collection
  ☆16Updated 3 weeks ago
• allenai / ACCoRD
  ☆19Updated 2 years ago
• jerinphilip / ilmulti
  Tooling to play around with multilingual machine translation for Indian Languages.
  ☆22Updated 3 years ago
• LuisaMaerz / KnowMAN
  KnowMAN: Weakly Supervised Multinomial Adversarial Networks
  ☆12Updated 3 years ago
• nyu-mll / pretraining-learning-curves
  The repository for the paper "When Do You Need Billions of Words of Pretraining Data?"
  ☆21Updated 4 years ago
• yahshibu / nested-ner-tacl2020-flair
  Implementation of Nested Named Entity Recognition using Flair
  ☆24Updated 3 years ago
• jonathandunn / common_crawl_corpus
  Scripts for building a geo-located web corpus using Common Crawl data
  ☆11Updated last week
• BinWang28 / Sentence-Embedding-S3E
  Efficient Sentence Embedding via Semantic Subspace Analysis
  ☆14Updated 5 years ago