Textprep is an analyzing tool for both parallel and non-parallel corpus and its down-stream Natural Language Processing and Machine Translation tasks. It is designed especially for logographic languages such as Chinese and Japanese.
☆32Feb 25, 2019Updated 7 years ago
Alternatives and similar repositories for textprep
Users that are interested in textprep are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Keyaki Treebank Parsed Corpus☆10May 15, 2019Updated 6 years ago
- A monolingual parallel corpus for sentence simplification☆11Jul 4, 2016Updated 9 years ago
- We use phonetics as a feature to create a joint semantic-phonetic embedding and improve the neural machine translation between Chinese an…☆12Aug 3, 2021Updated 4 years ago
- Neural Network-based Statistical Machine Translation Toolkit.☆73Jul 24, 2017Updated 8 years ago
- C++ code of "Learning to Parse and Translate Improves Neural Machine Translation"☆21May 8, 2017Updated 8 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Syntactic evaluation sets, attribute-varying grammars, and code for replicating the CLAMS paper. ACL 2020.☆17Nov 26, 2024Updated last year
- Klexikon: A German Dataset for Joint Summarization and Simplification☆17Oct 5, 2022Updated 3 years ago
- Django+echarts+py2neo进行知识图谱的前端展示☆16Oct 13, 2020Updated 5 years ago
- Recursive Neural Tensor Networks☆11Feb 3, 2014Updated 12 years ago
- ☆10Aug 13, 2012Updated 13 years ago
- Resources for the OpenNMT hackathon☆51May 24, 2019Updated 6 years ago
- ☆20Sep 23, 2018Updated 7 years ago
- benchmarks for LLM tokenizers☆18Mar 25, 2026Updated 2 weeks ago
- ☆20Aug 17, 2021Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Zunda: Japanese Enhanced Modality Analyzer client for Python.☆10Nov 30, 2019Updated 6 years ago
- Automatically exported from code.google.com/p/transducersaurus☆11Apr 1, 2015Updated 11 years ago
- FlexiTokens☆19Dec 27, 2025Updated 3 months ago
- ☆34Nov 29, 2016Updated 9 years ago
- Data from KAIST (a Korean treebank).☆19Nov 12, 2025Updated 5 months ago
- ☆12Jan 21, 2017Updated 9 years ago
- chinese word segmentation based on rnn☆13Oct 14, 2016Updated 9 years ago
- Source code and data for the paper "Towards String-to-Tree Neural Machine Translation"☆16Dec 31, 2017Updated 8 years ago
- full text search engine based on compact data structures☆13Jan 26, 2015Updated 11 years ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- Code to support the paper "Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets"☆65Aug 31, 2021Updated 4 years ago
- Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation☆15Aug 27, 2024Updated last year
- Cynical data selection☆20Jan 16, 2021Updated 5 years ago
- Multiple Different Natural Language Processing Tasks in a Single Deep Model☆48Dec 5, 2018Updated 7 years ago
- The repository contains the dataset and the code of the paper: Document-Level Text Simplification: Dataset, Metric and Model.☆25Jun 2, 2023Updated 2 years ago
- ☆12Nov 17, 2018Updated 7 years ago
- ☆12Dec 19, 2023Updated 2 years ago
- ☆10Jan 12, 2018Updated 8 years ago
- A collection of various discourse segmenters☆10Jun 30, 2017Updated 8 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Dataset for TALLIP2019 paper "Ancient-Modern Chinese Translation with a New Large Training Dataset"☆26Jul 8, 2022Updated 3 years ago
- Implementation of Word Embedding-based Antonym Detection using Thesauri and Distributional Information in NAACL2015☆35Mar 8, 2022Updated 4 years ago
- Implementation of "Controlling Output Length in Neural Encoder-Decoders"☆42Jan 29, 2018Updated 8 years ago
- ☆12Sep 1, 2021Updated 4 years ago
- 青空文庫のテキストファイル☆14Feb 4, 2024Updated 2 years ago
- Emacs Lisp parser for Python☆14Oct 15, 2015Updated 10 years ago
- PythonとCythonで出来てる日本語形態素解析エンジン🚧☆13Dec 4, 2019Updated 6 years ago