Textprep is an analyzing tool for both parallel and non-parallel corpus and its down-stream Natural Language Processing and Machine Translation tasks. It is designed especially for logographic languages such as Chinese and Japanese.
☆32Feb 25, 2019Updated 7 years ago
Alternatives and similar repositories for textprep
Users that are interested in textprep are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Deep Inside-Outside Recursive Autoencoder☆89Jan 17, 2022Updated 4 years ago
- Keyaki Treebank Parsed Corpus☆10May 15, 2019Updated 7 years ago
- A monolingual parallel corpus for sentence simplification☆11Jul 4, 2016Updated 9 years ago
- We use phonetics as a feature to create a joint semantic-phonetic embedding and improve the neural machine translation between Chinese an…☆12Aug 3, 2021Updated 4 years ago
- BERT models for many languages created from Wikipedia texts☆33May 25, 2020Updated 6 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Neural Network-based Statistical Machine Translation Toolkit.☆73Jul 24, 2017Updated 8 years ago
- Syntactic evaluation sets, attribute-varying grammars, and code for replicating the CLAMS paper. ACL 2020.☆17Nov 26, 2024Updated last year
- Recursive Neural Tensor Networks☆11Feb 3, 2014Updated 12 years ago
- ☆10Aug 13, 2012Updated 13 years ago
- benchmarks for LLM tokenizers☆18Mar 25, 2026Updated 2 months ago
- Japanese Argument Structure Analyzer (ASA) client for Python☆11Feb 16, 2019Updated 7 years ago
- ☆10Oct 16, 2017Updated 8 years ago
- A High-Quality Multilingual Dataset for Structured Documentation Translation☆39May 1, 2025Updated last year
- ☆20Aug 17, 2021Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Zunda: Japanese Enhanced Modality Analyzer client for Python.☆10Nov 30, 2019Updated 6 years ago
- Automatically exported from code.google.com/p/transducersaurus☆11Apr 1, 2015Updated 11 years ago
- AutoML Workshop (Azure Machine Learning mainly)☆13Jan 5, 2020Updated 6 years ago
- C++ code of "Tree-to-Sequence Attentional Neural Machine Translation (tree2seq ANMT)"☆57Jun 23, 2017Updated 8 years ago
- ☆34Nov 29, 2016Updated 9 years ago
- A localized word dictionary asset for University of Tsukuba☆12Sep 19, 2025Updated 8 months ago
- chinese word segmentation based on rnn☆13Oct 14, 2016Updated 9 years ago
- Source code and data for the paper "Towards String-to-Tree Neural Machine Translation"☆16Dec 31, 2017Updated 8 years ago
- full text search engine based on compact data structures☆13Jan 26, 2015Updated 11 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code to support the paper "Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets"☆65Aug 31, 2021Updated 4 years ago
- Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation☆15Aug 27, 2024Updated last year
- Cynical data selection☆20Jan 16, 2021Updated 5 years ago
- Multiple Different Natural Language Processing Tasks in a Single Deep Model☆48Dec 5, 2018Updated 7 years ago
- The repository contains the dataset and the code of the paper: Document-Level Text Simplification: Dataset, Metric and Model.☆25Jun 2, 2023Updated 3 years ago
- ☆12Nov 17, 2018Updated 7 years ago
- ☆12Dec 19, 2023Updated 2 years ago
- ☆10Jan 12, 2018Updated 8 years ago
- A collection of various discourse segmenters☆10Jun 30, 2017Updated 8 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆53Jun 2, 2026Updated last week
- Dataset for TALLIP2019 paper "Ancient-Modern Chinese Translation with a New Large Training Dataset"☆27Jul 8, 2022Updated 3 years ago
- Implementation of "Controlling Output Length in Neural Encoder-Decoders"☆42Jan 29, 2018Updated 8 years ago
- auto refresh no-ip free domain, avoid 30 days expiration☆14Aug 1, 2019Updated 6 years ago
- Machine Translation from English to Odia language.☆10Aug 9, 2021Updated 4 years ago
- Expletives vomiting library...☆13Apr 18, 2026Updated last month
- 青空文庫のテキストファイル☆14Feb 4, 2024Updated 2 years ago