Corpus preprocessing
☆100Mar 16, 2024Updated last year
Alternatives and similar repositories for preprocess
Users that are interested in preprocess are comparing it to the libraries listed below
Sorting:
- Transform TMX to text☆28Nov 23, 2022Updated 3 years ago
- Phonetic and phonological vocoding platform☆17Nov 23, 2016Updated 9 years ago
- ☆13Aug 23, 2024Updated last year
- Converts Quora's new NLU dataset to SNLI txt/jsonl format, plus test/dev split, tokenization.☆14Jan 27, 2017Updated 9 years ago
- This is an extension of kaldi speech recognition software which allows to perform decoding of speech with hybrid word and phoneme graphs.…☆11Feb 4, 2020Updated 6 years ago
- Crawling engine that crawls a set of top-level domains looking for documents in a list of languages☆11Feb 6, 2024Updated 2 years ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆160Jun 18, 2024Updated last year
- Tool for manual evaluation of parallel sentences.☆15Jan 26, 2026Updated last month
- bin files☆13Jan 30, 2025Updated last year
- ☆24Nov 29, 2017Updated 8 years ago
- ☆14Jun 12, 2015Updated 10 years ago
- A simple tutorial on setting up Sparrowhawk - a text-to-speech normalization engine☆14Oct 16, 2017Updated 8 years ago
- Tweets annotated with coarse-grained sense labels (supersenses)☆13Jun 13, 2014Updated 11 years ago
- Post-editing Datasets by Rakuten (PEDRa)☆14Jun 23, 2021Updated 4 years ago
- Efficient teacher-student models and scripts to make them☆54Dec 16, 2023Updated 2 years ago
- A library for data streaming and augmentation☆21May 5, 2025Updated 9 months ago
- ☆41Jun 25, 2018Updated 7 years ago
- Dockerized NMT frameworks for nmt-wizard☆39Apr 18, 2023Updated 2 years ago
- A GPU language model, based on btree backed tries.☆29Mar 6, 2018Updated 7 years ago
- Various scripts that facilitate the preparation of Automatic Speech Recognition related resources☆17Apr 16, 2020Updated 5 years ago
- c++ mosestokenizer☆18Mar 13, 2024Updated last year
- bilingual dictionary extractor from parallel corpora☆23Jul 3, 2014Updated 11 years ago
- The Community-enRiched Open WordNet (CROWN)☆18Dec 3, 2015Updated 10 years ago
- Server framework for Kaldi ASR Toolkit☆98Sep 17, 2023Updated 2 years ago
- OxLM: Oxford Neural Language Modelling Toolkit☆38Nov 6, 2015Updated 10 years ago
- Bitextor generates translation memories from multilingual websites☆301Nov 11, 2024Updated last year
- Multilingual grapheme-to-phoneme conversion☆20Feb 23, 2018Updated 8 years ago
- A fast parallel PyTorch implementation of the "CIF: Continuous Integrate-and-Fire for End-to-End Speech Recognition" https://arxiv.org/ab…☆36Feb 10, 2024Updated 2 years ago
- ☆21May 30, 2022Updated 3 years ago
- Links to data used in Sproat & Jaitly (https://arxiv.org/abs/1611.00068) experiments.☆77Jul 9, 2021Updated 4 years ago
- Scripts to preprocess training and test data and to run fast_align and giza☆107Nov 2, 2021Updated 4 years ago
- Project OCELoT: an Open, Collaborative Evaluation Leaderboard of Translations☆23Nov 5, 2025Updated 3 months ago
- BurrMill core☆22Nov 2, 2021Updated 4 years ago
- Learning word representation jointly using a corpus and a knowledge base (KB)☆19Oct 19, 2018Updated 7 years ago
- ☆27Jan 7, 2017Updated 9 years ago
- Code for the collection and analysis of the MTNT dataset☆56Apr 2, 2019Updated 6 years ago
- Kaldi Speech Processing Tools☆25Nov 16, 2018Updated 7 years ago
- Top level code to transcribe English audio/video files into text/subtitles☆21Jun 12, 2018Updated 7 years ago
- A Cython wrapper to BLAS and LAPACK☆44Oct 22, 2013Updated 12 years ago