seomoz / simhash-cluster
A cluster implementation of simhash near-duplicate detection
☆32Updated 10 years ago
Alternatives and similar repositories for simhash-cluster:
Users that are interested in simhash-cluster are comparing it to the libraries listed below
- Python API for Various DB-Backed Simhash Clusters☆64Updated 8 years ago
- Distributed text analysis suite based on Celery☆95Updated 2 years ago
- An easy-install script for LibShortText☆27Updated 10 years ago
- tyccl(同义词词林) is a ruby gem that provides friendly functions to analyse similarity between Chinese Words.☆46Updated 11 years ago
- An efficient simhash implementation for python☆124Updated 5 years ago
- Non-Overlapping Aho-Corasick Python extension, for Python 2 (str and unicode) and Python 3☆51Updated 9 years ago
- A middleware to use random user agent in Scrapy crawler.☆33Updated 12 years ago
- autocomplete-redis is a quora like automatic autocompletion based on redis.☆204Updated 11 years ago
- Pure python NLP toolkit☆55Updated 9 years ago
- A python implementation of DEPTA☆83Updated 8 years ago
- A flexible web crawler based on Scrapy for fetching most of Ajax or other various types of web pages. Easy to use: To customize a new web…☆45Updated 9 years ago
- ☆33Updated 11 years ago
- Output scrapy statistics to graphite/carbon☆54Updated 12 years ago
- tools for chinese word segmentation and pos tagging written in python☆38Updated 11 years ago
- Python bloom filter using redis as a shared backend.☆19Updated 7 years ago
- Efficiently search the most similar strings against the query in Python.☆18Updated last month
- A scrapy zhihu crawler☆76Updated 6 years ago
- hanLP-python server api☆12Updated 8 years ago
- tag doc using topN words with lda☆10Updated 9 years ago
- Chinese Tokenizer; New words Finder. 中文三段式机械分词算法; 未登录新词发现算法☆95Updated 8 years ago
- convert sogou input dict ( .scel file ) to mmseg(coreseek) dict☆97Updated 11 years ago
- Python ports of Lire image-analysis algorithms. http://github.com/fish2000/pylire☆7Updated 8 years ago
- 中国高校更名记录合并☆13Updated 9 years ago
- The experiment software underlying two papers published at ECIR-2015 and SEMEVAL-2015.☆37Updated 10 years ago
- a text analyzing (match, rewrite, extract) engine (python edition)☆80Updated 7 years ago
- python-segment是一个纯python实现的分词库,他的目标是提供一个可用的,完善的分词系统和训练环境,包括一个可用的词典。☆16Updated 11 years ago
- the Chinese NLP full stack toolkit☆41Updated 10 years ago
- Yet another Chinese word segmentation package based on character-based tagging heuristics and CRF algorithm☆245Updated 12 years ago
- A distributed Sina Weibo Search spider base on Scrapy and Redis.☆145Updated 11 years ago
- Different approaches to computing document similarity☆28Updated 8 years ago