This is a Python binding to the tokenizer Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task, yet it is not always as trivial a task as it appears to be. This binding makes the power of the ucto tokeniser available to Python. Ucto itself is regular-expression based, extensible, and advanced tokeniser writt…
☆32Aug 20, 2026Updated 3 weeks ago
Alternatives and similar repositories for python-ucto
Users that are interested in python-ucto are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- C++ implementation of Generalised Brown clustering and python scripts for feature generation☆41Apr 8, 2016Updated 10 years ago
- Yet Another Sequence Encoder - Encode sequences to vector of vector in python !☆14May 15, 2017Updated 9 years ago
- Fetch and parse the American Presidency Project's press-briefing and presidential-news-conference transcripts.☆11Aug 18, 2016Updated 10 years ago
- Artistic Data Visualization☆11May 29, 2018Updated 8 years ago
- A bag of miscellaneous demos!☆13Feb 5, 2017Updated 9 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Python bindings to the dutch NLP tool Frog (pos tagger, lemmatiser, NER tagger, morphological analysis, shallow parser, dependency parser…☆50Aug 20, 2026Updated 3 weeks ago
- Mine conversations from novels in Project Gutenberg, to generate data for data-driven dialogue systems.☆15May 7, 2019Updated 7 years ago
- A software to detect text reuse with BLAST.☆13Oct 8, 2019Updated 6 years ago
- word count of large file using prefix tree and parallel python processes☆18Sep 25, 2013Updated 12 years ago
- Context Aware Language Models☆28Jul 3, 2018Updated 8 years ago
- Implementation of provably Rawlsian fair ML algorithms for contextual bandits.☆15May 10, 2017Updated 9 years ago
- A tool to start ArangoDB clusters and single servers conveniently.☆13Feb 10, 2017Updated 9 years ago
- FoLiA library for C++☆18Mar 25, 2026Updated 5 months ago
- weighted deepwalk implementation in c++☆18Feb 8, 2017Updated 9 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Python implementation of cover trees, near-drop-in replacement for scipy.spatial.kdtree☆32Mar 13, 2012Updated 14 years ago
- A sentence aligner for comparable corpora☆131May 19, 2016Updated 10 years ago
- Named Entity Recognition (LSTM + CRF + FastText) with models for [historic] German☆26May 10, 2021Updated 5 years ago
- First steps in Machine Learning☆12Mar 18, 2015Updated 11 years ago
- Colibri core is an NLP tool as well as a C++ and Python library for working with basic linguistic constructions such as n-grams and skipg…☆133Feb 5, 2026Updated 7 months ago
- Simple CORPORA list crawler☆11Dec 2, 2016Updated 9 years ago
- Yet Another SEquence Tagger☆10Dec 8, 2022Updated 3 years ago
- Tweets annotated with coarse-grained sense labels (supersenses)☆13Jun 13, 2014Updated 12 years ago
- Curated set of transformers that make your work with steppy faster and more effective☆23Nov 22, 2018Updated 7 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Fast structured perceptron sequential labeler☆15Dec 8, 2015Updated 10 years ago
- Deep learning spelling patterns with a recurrent neural network☆11Jun 5, 2017Updated 9 years ago
- A Python implementation of word2vec that allows custom sampling strategies☆10Jan 30, 2014Updated 12 years ago
- Natural language Understanding Toolkit☆119May 7, 2014Updated 12 years ago
- Business and performance KPIs drawn from game analytics using a large dataset☆11Mar 2, 2019Updated 7 years ago
- Translation of query languages to serialized KoralQuery protocol☆15Sep 8, 2026Updated last week
- Re-usable low-level ML components☆11Oct 31, 2018Updated 7 years ago
- A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.☆13Jul 31, 2017Updated 9 years ago
- Load all concepts and relationships from UMLS into a Neo4j database☆13Jan 29, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A little Python script to generate Cohen's Kappa and Weighted Kappa measures for inter-rater reliability☆23Sep 17, 2019Updated 6 years ago
- GPU accelerated K-Means and Mean Shift clustering in Tensorflow.☆11Sep 24, 2018Updated 7 years ago
- ☆12Apr 13, 2023Updated 3 years ago
- Hugging Face and Pyserini interoperability☆20May 18, 2023Updated 3 years ago
- 2010-2014 American Movie Trailers☆11Mar 26, 2017Updated 9 years ago
- [WIP] Repository that scrapes and cleans data from: https://coronavirus.guanajuato.gob.mx/☆10Dec 8, 2022Updated 3 years ago
- Spiideo SoccerNet SynLoc - Single Frame World Coordinate Athlete Detection and Localization with Synthetic Data☆29Mar 27, 2026Updated 5 months ago