transducens / linguacrawl
Crawling engine that crawls a set of top-level domains looking for documents in a list of languages
☆11Updated 9 months ago
Related projects ⓘ
Alternatives and complementary repositories for linguacrawl
- LAReQA is a challenging benchmark for evaluating language agnostic answer retrieval from a multilingual candidate pool. This repository c…☆14Updated 4 years ago
- Statistics on multilingual datasets☆17Updated 2 years ago
- ☆17Updated last year
- BERT models for many languages created from Wikipedia texts☆34Updated 4 years ago
- Generate BERT vocabularies and pretraining examples from Wikipedias☆18Updated 4 years ago
- Implementation of Nested Named Entity Recognition using Flair☆24Updated 3 years ago
- ☆22Updated 2 years ago
- KnowMAN: Weakly Supervised Multinomial Adversarial Networks☆12Updated 3 years ago
- A web interface to understand language-specific BERT-models☆17Updated 6 months ago
- Combining encoder-based language models☆11Updated 2 years ago
- A simple neural truecaser written in pytorch and allennlp.☆31Updated 4 months ago
- Code for Paper "Target-oriented Fine-tuning for Zero-Resource Named Entity Recognition"☆21Updated 2 years ago
- A parallel evaluation data set of SAP software documentation with document structure annotation☆10Updated 2 months ago
- Tower Parse: Low-Resource Dependency Parsing via Hierarchical Source Selection☆15Updated 3 years ago
- Training a model without a dataset for natural language inference (NLI)☆25Updated 4 years ago
- Converter from UD-trees to BART representation☆36Updated 8 months ago
- Post-editing Datasets by Rakuten (PEDRa)☆14Updated 3 years ago
- As good as new. How to successfully recycle English GPT-2 to make models for other languages (ACL Findings 2021)☆46Updated 3 years ago
- SeqScore: Scoring for named entity recognition and other sequence labeling tasks☆20Updated 3 weeks ago
- This repository hosts the code for a tokenizer of tweets.☆12Updated 5 years ago
- Implementation of the paper 'Sentence Bottleneck Autoencoders from Transformer Language Models'☆17Updated 2 years ago
- ☆19Updated 2 years ago
- Dataset of sentences from Hindi stories tagged with different emotion tags☆10Updated 4 years ago
- A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and …☆49Updated 4 years ago
- Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"☆26Updated 3 years ago
- Code for the paper: Saying No is An Art: Contextualized Fallback Responses for Unanswerable Dialogue Queries☆19Updated 2 years ago
- Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"☆31Updated 2 years ago
- A set of methods for finding an appropriate number of topics in a text collection☆14Updated 3 months ago
- Official codebase accompanying our ACL 2022 paper "RELiC: Retrieving Evidence for Literary Claims" (https://relic.cs.umass.edu).☆20Updated 2 years ago