mingruimingrui / ICU-tokenizerLinks
ICU based universal language tokenizer
☆33Updated 3 years ago
Alternatives and similar repositories for ICU-tokenizer
Users that are interested in ICU-tokenizer are comparing it to the libraries listed below
Sorting:
- Language-agnostic BERT Sentence Embedding (LaBSE)☆152Updated 4 years ago
- CharBERT: Character-aware Pre-trained Language Model (COLING2020)☆121Updated 4 years ago
- code and data to faciliate BERT/ELECTRA for document ranking. Details refer to the paper - PARADE: Passage Representation Aggregation for…☆97Updated 2 years ago
- AAAI-20 paper: Cross-Lingual Natural Language Generation via Pre-Training☆129Updated 4 years ago
- A library to conduct ranking experiments with transformers.☆160Updated 2 years ago
- SpanNER: Named EntityRe-/Recognition as Span Prediction☆131Updated 3 years ago
- ☆42Updated 4 years ago
- ☆36Updated 3 years ago
- [NeurIPS 2021] COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining☆117Updated 2 years ago
- Self-supervised NER prototype - updated version (69 entity types - 17 broad entity groups). Uses pretrained BERT models with no fine tuni…☆78Updated 3 years ago
- SUPERT: Unsupervised multi-document summarization evaluation & generation☆95Updated 2 years ago
- Dataset for NAACL 2021 paper: "DART: Open-Domain Structured Data Record to Text Generation"☆155Updated 2 years ago
- ☆92Updated 3 years ago
- source code for paper: WhiteningBERT: An Easy Unsupervised Sentence Embedding Approach.☆56Updated 4 years ago
- Pytorch-version BERT-flow: One can apply BERT-flow to any PLM within Pytorch framework.☆72Updated 3 years ago
- ☆67Updated 3 years ago
- ☆87Updated 3 years ago
- This repo supports various cross-lingual transfer learning & multilingual NLP models.☆92Updated last year
- BERTserini☆26Updated 2 years ago
- Named Entity Recognition with Small Strongly Labeled and Large Weakly Labeled Data☆100Updated 2 years ago
- ☆62Updated 2 years ago
- Implementation of pQRNN in PyTorch☆46Updated 3 years ago
- XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning☆104Updated 4 years ago
- Multilingual abstractive summarization dataset extracted from WikiHow.☆94Updated 5 months ago
- Evaluation script for named entity recognition (NER) systems based on entity-level F1 score.☆69Updated 4 years ago
- ☆55Updated 7 years ago
- X-BERT: eXtreme Multi-label Text Classification with BERT☆52Updated 6 years ago
- Generalizing Natural Language Analysis through Span-relation Representations☆91Updated 2 years ago
- Repository for the paper "Named Entity Recognition for Entity Linking: What Works and What's Next" (EMNLP 2021).☆76Updated 3 years ago
- A data explorer for DROP dataset☆22Updated 2 years ago