microsoft / factored-segmenter
Unsupervised factor-based text tokenizer for natural-language processing applications
☆17Updated 4 years ago
Alternatives and similar repositories for factored-segmenter
Users that are interested in factored-segmenter are comparing it to the libraries listed below
Sorting:
- Microsoft Speech Language Translation (MSLT) Corpus☆19Updated 7 years ago
- Machine is a natural language processing library for .NET that is focused on providing tools for processing resource-poor languages.☆28Updated last week
- ☆26Updated last year
- Automatically exported from code.google.com/p/m2m-aligner☆42Updated 9 years ago
- SIGMORPHON 2022 Shared Task on Morpheme Segmentation☆26Updated 2 years ago
- NTREX -- News Test References for MT Evaluation☆83Updated 11 months ago
- Bicleaner fork that uses neural networks☆40Updated this week
- Numpy style scientific programming package☆18Updated 5 years ago
- Port of PragmaticSegmenter for sentence boundary detection☆35Updated 3 years ago
- C# Word2Vec object with fast neighbor search. Format compatible with gensim☆25Updated 5 years ago
- Improved Sentence Alignment in Linear Time and Space☆171Updated 2 years ago
- Efficient Low-Memory Aligner☆143Updated 4 months ago
- ☆12Updated 9 years ago
- SHAS: Approaching optimal Segmentation for End-to-End Speech Translation☆38Updated 2 years ago
- Multilingual sentence alignment using sentence embeddings☆117Updated 6 months ago
- ☆42Updated 6 years ago
- Bilingual sentence similarity classifier using Tensorflow☆21Updated 5 years ago
- The CMU Pronouncing Dictionary converted to IPA☆82Updated 5 years ago
- Efficient Markov Chain word alignment☆53Updated 3 years ago
- Large scale (>200h) and publicly available read audio book corpus. This corpus is an augmentation of LibriSpeech ASR Corpus (1000h) and c…☆43Updated 2 years ago
- An easy-to-use library to linguistically compare one sentence and its words to another, in the same language or a different one. For inst…☆22Updated 3 years ago
- Tools for filtering and cleaning parallel and monolingual corpora for machine translation and other natural language processing tasks.☆41Updated last year
- A library for minimum Bayes risk (MBR) decoding☆37Updated last month
- This repo contains a set of neural transducer, e.g. sequence-to-sequence model, focusing on character-level tasks.☆75Updated last year
- .NET researching application for rendering, recording, playback, analyzing and compression of audio data.☆10Updated 8 years ago
- OPUS-CAT is a collection of software which make it possible to OPUS-MT neural machine translation models in professional translation. OPU…☆78Updated 3 months ago
- A High-Quality Multilingual Dataset for Structured Documentation Translation☆36Updated 2 weeks ago
- OpusFilter - Parallel corpus processing toolkit☆104Updated last month
- Corpus preprocessing☆96Updated last year
- Complimentary code for our paper Automatic punctuation restoration with BERT models☆49Updated last year