A fast, simple, multilingual tokenizer
☆29May 24, 2017Updated 9 years ago
Alternatives and similar repositories for tok-tok
Users that are interested in tok-tok are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Command-line corpus tools☆12May 15, 2017Updated 9 years ago
- Fast Word Clustering Software☆79Feb 8, 2025Updated last year
- Easy language identification of 380 languages☆17Dec 2, 2019Updated 6 years ago
- MIZAN: a large persian-english parallel corpus☆30Sep 15, 2020Updated 6 years ago
- 🤗 ParsBERT Persian NER Tasks☆18Jun 17, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆12Feb 9, 2019Updated 7 years ago
- Accompanying code for our EMNLP 2017 publication "GraphDocExplore: A Framework for the Experimental Comparison of Graph-based Document Ex…☆27May 27, 2023Updated 3 years ago
- Submission to the Yelp Dataset Challenge 2017☆15Jun 30, 2017Updated 9 years ago
- a conversion of Dadegan corpus (first Persian dependency corpus) to the universal dependency version☆15Sep 8, 2026Updated 2 weeks ago
- MirasText☆76Aug 12, 2020Updated 6 years ago
- A small, useful collection of pandoc filters☆13Apr 5, 2025Updated last year
- Persian Stemming data-set in order to evaluate new stemmers☆15Dec 16, 2016Updated 9 years ago
- AROW++ An implementation of the efficient confidence-weighted classifier☆11Jan 9, 2021Updated 5 years ago
- Generate crappy products and reviews using Amazon's dataset☆17Jan 11, 2016Updated 10 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Scrape South African news☆14May 22, 2023Updated 3 years ago
- A natural language processing tool for automatically detecting quotations in text.☆15Feb 26, 2022Updated 4 years ago
- Python package to augment multilingual data☆15Feb 15, 2023Updated 3 years ago
- An Implementation of Transformer (Attention Is All You Need) in DyNet☆64Nov 30, 2023Updated 2 years ago
- Tools for extracting parallel corpora from article titles across languages in Wikipedia☆74Feb 25, 2015Updated 11 years ago
- Use spaCy for NLP and output to the FoLiA XML format.☆12Feb 27, 2024Updated 2 years ago
- Semantic Parser Localizer (SPL) code repository☆10Mar 15, 2021Updated 5 years ago
- UCSF Philter for UC☆16Jul 8, 2024Updated 2 years ago
- CLI tool for exploring arXiv (inspired by karpathy's brilliant ArXiv Sanity Preserver)☆39May 8, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Named-Entity Recognition in Persian Language☆62Jul 23, 2020Updated 6 years ago
- maximum entropy based part-of-speech tagger for NLTK☆45Dec 8, 2016Updated 9 years ago
- Python evaluation scripts for AIDA-formatted CoNLL data☆20Aug 4, 2014Updated 12 years ago
- ☆12Jun 8, 2021Updated 5 years ago
- مشهدلاگ، اجتماع آزادی از دوستداران گنو/لینوکس است که بیشتر در شهر مشهد زندگی میکنند. ما به گرمی به کسانی که تمایل دارند به اجتماع ما ب…☆10Oct 24, 2025Updated 11 months ago
- tools to analyze a collection of texts and identify relevant words☆12May 20, 2018Updated 8 years ago
- ChatGPT plugin for Singapore HDB car park availability☆19Jun 7, 2023Updated 3 years ago
- Handle Big Data for Machine Learning using Python and PySpark, Building ETL Pipelines with PySpark, MongoDB, and Bokeh☆10Nov 12, 2021Updated 4 years ago
- Java implementation of the brown clustering algorithm that clusters words based on their contexts in a text corpus.☆11Mar 2, 2018Updated 8 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Android library providing components for capturing, reviewing and analyzing photos of invoices and remittance slips.☆11Jun 7, 2022Updated 4 years ago
- Code samples from my blog, https://poanchen.github.io/blog/☆12Oct 28, 2020Updated 5 years ago
- NDSLICE wrapper for LAPACK☆12Dec 19, 2023Updated 2 years ago
- Pyramidal Recurrent Units (PRUs): A New LSTM Unit☆10Aug 29, 2018Updated 8 years ago
- Fine-grained sentiment annotations of NoReC☆20Aug 1, 2022Updated 4 years ago
- AVID: Adversarial Visual Irregularity Detection☆12Oct 27, 2024Updated last year
- A tutorial about DBpedia and Linked Data in general☆24Nov 7, 2014Updated 11 years ago