seomoz / simhash-clusterLinks
A cluster implementation of simhash near-duplicate detection
☆32Updated 10 years ago
Alternatives and similar repositories for simhash-cluster
Users that are interested in simhash-cluster are comparing it to the libraries listed below
Sorting:
- Python API for Various DB-Backed Simhash Clusters☆64Updated 8 years ago
- An efficient simhash implementation for python☆126Updated 5 years ago
- Distributed text analysis suite based on Celery☆96Updated 2 years ago
- Non-Overlapping Aho-Corasick Python extension, for Python 2 (str and unicode) and Python 3☆51Updated 10 years ago
- An easy-install script for LibShortText☆27Updated 10 years ago
- Fast multi-keyword search engine for text strings☆256Updated 11 months ago
- A python implementation of DEPTA☆83Updated 8 years ago
- Chinese Words Segment Library based on HMM model☆166Updated 11 years ago
- Yet another Chinese word segmentation package based on character-based tagging heuristics and CRF algorithm☆245Updated 12 years ago
- A middleware to use random user agent in Scrapy crawler.☆33Updated 12 years ago
- a chinese segment base on crf☆234Updated 6 years ago
- [NO LONGER MAINTAINED AS OPEN SOURCE - USE SCALETEXT.COM INSTEAD]☆108Updated 12 years ago
- Implementation of Vision Based Page Segmentation algorithm in Java☆103Updated 5 years ago
- Replication software, data, and supplementary materials for the paper: O'Connor, Stewart and Smith, ACL-2013, "Learning to Extract Intern…☆26Updated 4 years ago
- A tool to segment text based on frequencies and the Viterbi algorithm "#TheBoyWhoLived" => ['#', 'The', 'Boy', 'Who', 'Lived']☆81Updated 9 years ago
- A flexible web crawler based on Scrapy for fetching most of Ajax or other various types of web pages. Easy to use: To customize a new web…☆45Updated 9 years ago
- C++ Ternary Search Tree implementation with Python bindings☆43Updated 7 years ago
- a text analyzing (match, rewrite, extract) engine (python edition)☆80Updated 8 years ago
- Structured Data Extractor. An application to extract structured data from web pages. It uses Data Extraction Based on Partial Tree Alignm…☆49Updated 13 years ago
- A readability parser which can extract title, content, images from html pages☆87Updated 5 years ago
- Pure python NLP toolkit☆55Updated 9 years ago
- Implements Rocchio Query Expansion - similar to "related searches:" found at popular search engines but based on relevant documents selec…☆20Updated 8 years ago
- The experiment software underlying two papers published at ECIR-2015 and SEMEVAL-2015.☆37Updated 10 years ago
- Different approaches to computing document similarity☆28Updated 8 years ago
- A tool for semantic relation extraction. The program finds pairs of semantically related words based on the text definitions coming from …☆26Updated 11 years ago
- Output scrapy statistics to graphite/carbon☆54Updated 12 years ago
- Automatic Item List Extraction☆87Updated 9 years ago
- Preparing DMOZ dataset for my n-Gram LM-based URL classification research☆32Updated 11 years ago
- MinorThird is a collection of Java classes for storing text, annotating text, and learning to extract entities and categorize text.☆58Updated 7 years ago
- A Python package for pullword.com☆86Updated 5 years ago