seomoz / simhash-py
Simhash and near-duplicate detection
☆409Updated last year
Related projects ⓘ
Alternatives and complementary repositories for simhash-py
- A Python Implementation of Simhash Algorithm☆980Updated 2 years ago
- An efficient simhash implementation for python☆124Updated 5 years ago
- Python API for Various DB-Backed Simhash Clusters☆64Updated 7 years ago
- Heuristic based boilerplate removal tool☆727Updated 6 months ago
- Python interface to Boilerpipe, Boilerplate Removal and Fulltext Extraction from HTML pages☆539Updated 3 years ago
- Automatically exported from code.google.com/p/chromium-compact-language-detector☆160Updated 4 years ago
- A python implementation of the Rapid Automatic Keyword Extraction☆375Updated 6 years ago
- English word segmentation, written in pure-Python, and based on a trillion-word corpus.☆365Updated last year
- Fast multi-keyword search engine for text strings☆247Updated last month
- Python extension module for accelerating regular expressions using libesm☆132Updated last year
- NER toolkit for HTML data☆256Updated 6 months ago
- Source code for the paper "Web2Text: Deep Structured Boilerplate Removal", full paper @ ECIR'18☆167Updated 3 years ago
- Simhashing in C++☆134Updated last year
- Web Content Extraction Through Machine Learning☆185Updated 10 years ago
- Locality Sensitive Hashing using MinHash in Python/Cython to detect near duplicate text documents☆281Updated last year
- Fast, efficiently stored Trie for Python. Uses libdatrie.☆530Updated 9 months ago
- ☆260Updated 4 years ago
- Pure python Aho-Corasick library.☆212Updated last year
- Python module (C extension and plain python) implementing Aho-Corasick algorithm☆949Updated 7 months ago
- A python implementation of the Rapid Automatic Keyword Extraction☆974Updated 4 years ago
- A Learning to Rank Library☆135Updated 12 years ago
- Python implementation of TextRank algorithm for automatic keyword extraction and summarization using Levenshtein distance as relation bet…☆765Updated 2 years ago
- Example Python code for comparing documents using MinHash☆250Updated 5 years ago
- Just the facts -- web page content extraction☆1,252Updated 4 months ago
- Quickly extract multi-word phrases from a corpus☆191Updated 4 years ago
- High performance Trie and Ahocorasick automata (AC automata) Keyword Match & Replace Tool for python. Correct case insensitive implementa…☆94Updated 3 weeks ago
- Python interface to the Stanford Named Entity Recognizer☆293Updated 3 years ago
- Demonstration of using Python to process the Common Crawl dataset with the mrjob framework☆166Updated 2 years ago
- Process Common Crawl data with Python and Spark☆405Updated last month