seomoz / simhash-cluster
A cluster implementation of simhash near-duplicate detection
☆32Updated 9 years ago
Alternatives and similar repositories for simhash-cluster:
Users that are interested in simhash-cluster are comparing it to the libraries listed below
- Python API for Various DB-Backed Simhash Clusters☆64Updated 7 years ago
- Distributed text analysis suite based on Celery☆95Updated 2 years ago
- Pure python NLP toolkit☆55Updated 9 years ago
- Non-Overlapping Aho-Corasick Python extension, for Python 2 (str and unicode) and Python 3☆51Updated 9 years ago
- A readability parser which can extract title, content, images from html pages☆86Updated 4 years ago
- 使用Pykafka的正确姿势☆32Updated 9 years ago
- An efficient simhash implementation for python☆124Updated 5 years ago
- A flexible web crawler based on Scrapy for fetching most of Ajax or other various types of web pages. Easy to use: To customize a new web…☆45Updated 9 years ago
- Chinese Tokenizer; New words Finder. 中文三段式机械分词算法; 未登录新词发现算法☆95Updated 8 years ago
- A scrapy zhihu crawler☆76Updated 6 years ago
- python-segment是一个纯python实现的分词库,他的目标是提供一个可用的,完善的分词系统和训练环境,包括一个可用的词典。☆16Updated 11 years ago
- Different approaches to computing document similarity☆28Updated 8 years ago
- 使用simhash算法,快速索引和查询大量文本简历☆22Updated 9 years ago
- convert sogou input dict ( .scel file ) to mmseg(coreseek) dict☆97Updated 11 years ago
- C++ Ternary Search Tree implementation with Python bindings☆43Updated 7 years ago
- autocomplete-redis is a quora like automatic autocompletion based on redis.☆204Updated 11 years ago
- 搜索输入框-下拉提示(推荐), 提示词根据权重排序.基于double-array-trie的darts, golang语言实现.☆180Updated 8 years ago
- [NO LONGER MAINTAINED AS OPEN SOURCE - USE SCALETEXT.COM INSTEAD]☆108Updated 11 years ago
- ☆56Updated 6 months ago
- This open source project is a python wrapper for NLPIR.☆82Updated 9 years ago
- 中文分词程序,可以在没有中文语料库的情况下通过相关性将一段文本中的中文词汇抽取出来☆51Updated 11 years ago
- Python bloom filter using redis as a shared backend.☆19Updated 7 years ago
- A GBDT(MART) and LambdaMART training and predicting package☆14Updated 9 years ago
- tag doc using topN words with lda☆10Updated 9 years ago
- some ml demo(based on sklearn)☆12Updated 8 years ago
- A lot of useful functions/modules.☆29Updated 9 years ago
- An easy-install script for LibShortText☆27Updated 10 years ago
- 把之前 hanLP-python-flask 裡面的 hanLP 單獨分出來☆60Updated 7 years ago
- tools for chinese word segmentation and pos tagging written in python☆38Updated 11 years ago
- 为给定的一段文本抽取一个或多个基于知识树的标签。☆8Updated 9 years ago