Textprep is an analyzing tool for both parallel and non-parallel corpus and its down-stream Natural Language Processing and Machine Translation tasks. It is designed especially for logographic languages such as Chinese and Japanese.
☆32Feb 25, 2019Updated 7 years ago
Alternatives and similar repositories for textprep
Users that are interested in textprep are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Deep Inside-Outside Recursive Autoencoder☆89Jan 17, 2022Updated 4 years ago
- Keyaki Treebank Parsed Corpus☆10May 15, 2019Updated 7 years ago
- A monolingual parallel corpus for sentence simplification☆11Jul 4, 2016Updated 9 years ago
- We use phonetics as a feature to create a joint semantic-phonetic embedding and improve the neural machine translation between Chinese an…☆12Aug 3, 2021Updated 4 years ago
- BERT models for many languages created from Wikipedia texts☆33May 25, 2020Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Neural Network-based Statistical Machine Translation Toolkit.☆73Jul 24, 2017Updated 8 years ago
- C++ code of "Learning to Parse and Translate Improves Neural Machine Translation"☆21May 8, 2017Updated 9 years ago
- Syntactic evaluation sets, attribute-varying grammars, and code for replicating the CLAMS paper. ACL 2020.☆17Nov 26, 2024Updated last year
- Klexikon: A German Dataset for Joint Summarization and Simplification☆16Oct 5, 2022Updated 3 years ago
- Recursive Neural Tensor Networks☆11Feb 3, 2014Updated 12 years ago
- ☆10Aug 13, 2012Updated 13 years ago
- Resources for the OpenNMT hackathon☆51May 24, 2019Updated 6 years ago
- ☆20Sep 23, 2018Updated 7 years ago
- benchmarks for LLM tokenizers☆18Mar 25, 2026Updated last month
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆10Oct 16, 2017Updated 8 years ago
- A High-Quality Multilingual Dataset for Structured Documentation Translation☆39May 1, 2025Updated last year
- Zunda: Japanese Enhanced Modality Analyzer client for Python.☆10Nov 30, 2019Updated 6 years ago
- Automatically exported from code.google.com/p/transducersaurus☆11Apr 1, 2015Updated 11 years ago
- ☆34Nov 29, 2016Updated 9 years ago
- A localized word dictionary asset for University of Tsukuba☆12Sep 19, 2025Updated 8 months ago
- Data from KAIST (a Korean treebank).☆19May 6, 2026Updated 2 weeks ago
- ☆12Jan 21, 2017Updated 9 years ago
- chinese word segmentation based on rnn☆13Oct 14, 2016Updated 9 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Source code and data for the paper "Towards String-to-Tree Neural Machine Translation"☆16Dec 31, 2017Updated 8 years ago
- full text search engine based on compact data structures☆13Jan 26, 2015Updated 11 years ago
- Code to support the paper "Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets"☆65Aug 31, 2021Updated 4 years ago
- Cynical data selection☆20Jan 16, 2021Updated 5 years ago
- Multiple Different Natural Language Processing Tasks in a Single Deep Model☆48Dec 5, 2018Updated 7 years ago
- The repository contains the dataset and the code of the paper: Document-Level Text Simplification: Dataset, Metric and Model.☆25Jun 2, 2023Updated 2 years ago
- FlexiTokens☆23Dec 27, 2025Updated 4 months ago
- ☆12Nov 17, 2018Updated 7 years ago
- ☆10Jan 12, 2018Updated 8 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A collection of various discourse segmenters☆10Jun 30, 2017Updated 8 years ago
- ☆53Jul 25, 2023Updated 2 years ago
- Dataset for TALLIP2019 paper "Ancient-Modern Chinese Translation with a New Large Training Dataset"☆26Jul 8, 2022Updated 3 years ago
- Implementation of Word Embedding-based Antonym Detection using Thesauri and Distributional Information in NAACL2015☆35Mar 8, 2022Updated 4 years ago
- Implementation of "Controlling Output Length in Neural Encoder-Decoders"☆42Jan 29, 2018Updated 8 years ago
- ☆12Sep 1, 2021Updated 4 years ago
- auto refresh no-ip free domain, avoid 30 days expiration☆14Aug 1, 2019Updated 6 years ago