zaemyung / sentsplit
A flexible sentence segmentation library using CRF model and regex rules
☆29Updated last year
Alternatives and similar repositories for sentsplit
Users that are interested in sentsplit are comparing it to the libraries listed below
Sorting:
- Pytorch Implementation of EncT5: Fine-tuning T5 Encoder for Non-autoregressive Tasks☆63Updated 3 years ago
- Megatron LM 11B on Huggingface Transformers☆27Updated 3 years ago
- KETOD Knowledge-Enriched Task-Oriented Dialogue☆32Updated 2 years ago
- A Benchmark for Robust, Multi-evidence, Multi-answer Question Answering☆16Updated 2 years ago
- Implementation of stop sequencer for Huggingface Transformers☆16Updated last year
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆71Updated last year
- NeuralWOZ: Learning to Collect Task-Oriented Dialogue via Model-based Simulation (ACL-IJCNLP 2021)☆36Updated 3 years ago
- ☆29Updated 2 years ago
- Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP☆58Updated 2 years ago
- Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"☆30Updated 3 years ago
- ☆32Updated last month
- ↔️ T5 Machine Translation from English to Korean☆18Updated 2 years ago
- This tool helps automatic generation of grammatically valid synthetic Code-mixed data by utilizing linguistic theories such as Equivalenc…☆55Updated 9 months ago
- A tiny BERT for low-resource monolingual models☆31Updated 7 months ago
- ☆46Updated 3 years ago
- ☆20Updated 2 years ago
- Tool to fix bitexts and tag near-duplicates for removal☆30Updated 3 months ago
- ☆36Updated 2 years ago
- Code and data for the IWSLT 2022 shared task on Formality Control for SLT☆21Updated last year
- Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"☆27Updated 3 years ago
- ☆25Updated last year
- ☆10Updated 3 years ago
- ☆44Updated 4 years ago
- A repository for experiments in quality-aware decoding☆16Updated 2 years ago
- BERT models for many languages created from Wikipedia texts☆33Updated 4 years ago
- IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…☆32Updated 11 months ago
- Personal information identification standard☆20Updated last year
- Implementation of the paper 'Plug and Play Autoencoders for Conditional Text Generation'☆43Updated 4 years ago
- FactSumm: Factual Consistency Scorer for Abstractive Summarization☆110Updated last year
- PyTorch implementation of NAACL 2021 paper "Multi-view Subword Regularization"☆25Updated 3 years ago