Alternatives and similar repositories for spider

Users that are interested in spider are comparing it to the libraries listed below

• rodricios / eatiht
  An exercise in unsupervised machine learning: Extract Article's Text in HTml documents.
  ☆432Updated last year
• scrapinghub / aile
  Automatic Item List Extraction
  ☆87Updated 8 years ago
• DiceTechJobs / ConceptualSearch
  Train a Word2Vec model or LSA model, and Implement Conceptual Search\Semantic Search in Solr\Lucene - Simon Hughes Dice.com, Dice Tech Jo…
  ☆257Updated 6 years ago
• misja / python-boilerpipe
  Python interface to Boilerpipe, Boilerplate Removal and Fulltext Extraction from HTML pages
  ☆542Updated 3 years ago
• scrapinghub / webstruct
  NER toolkit for HTML data
  ☆259Updated last year
• pandastrike / bayzee
  Text classification using Naive Bayes and Elasticsearch
  ☆154Updated 8 years ago
• gogartom / TextMaps
  ☆91Updated 9 years ago
• dragnet-org / dragnet
  Just the facts -- web page content extraction
  ☆1,266Updated 11 months ago
• nik0spapp / sdalg
  Web page segmentation and noise removal
  ☆55Updated last year
• dalab / web2text
  Source code for the paper "Web2Text: Deep Structured Boilerplate Removal", full paper @ ECIR'18
  ☆169Updated 3 years ago
• seomoz / dragnet_data
  Training/test data for Dragnet
  ☆41Updated 10 years ago
• MLnick / elasticsearch-vector-scoring
  Score documents with pure dot product / cosine similarity with ES
  ☆251Updated 3 years ago
• seagatesoft / webdext
  Intelligent Web Data Extractor
  ☆74Updated 2 years ago
• piskvorky / gensim-simserver
  [NO LONGER MAINTAINED AS OPEN SOURCE - USE SCALETEXT.COM INSTEAD]
  ☆108Updated 12 years ago
• scrapinghub / page_clustering
  A simple algorithm for clustering web pages, suitable for crawlers
  ☆34Updated 8 years ago
• piskvorky / sim-shootout
  Code for "Performance shootout between nearest-neighbour libraries": http://radimrehurek.com/2013/11/performance-shootout-of-nearest-neig…
  ☆99Updated 9 years ago
• seomoz / simhash-py
  Simhash and near-duplicate detection
  ☆415Updated 2 years ago
• yuhui-lin / web_page_classification
  Deep learning algorithms for web page classification written in Tensorflow (Python).
  ☆24Updated 2 years ago
• tpopela / vips_java
  Implementation of Vision Based Page Segmentation algorithm in Java
  ☆102Updated 5 years ago
• trivio / common_crawl_index
  Index URLs in Common Crawl
  ☆194Updated 7 years ago
• scrapinghub / python-simhash
  An efficient simhash implementation for python
  ☆125Updated 5 years ago
• mikemccand / chromium-compact-language-detector
  Automatically exported from code.google.com/p/chromium-compact-language-detector
  ☆162Updated 4 years ago
• shuyo / ldig
  Language Detection with Infinity-gram
  ☆230Updated 9 years ago
• scrapinghub / mdr
  A python library detect and extract listing data from HTML page.
  ☆108Updated 8 years ago
• giacbrd / ShallowLearn
  An experiment about re-implementing supervised learning models based on shallow neural network approaches (e.g. fastText) with some addit…
  ☆198Updated 7 years ago
• JDonner / NoAho
  Non-Overlapping Aho-Corasick Python extension, for Python 2 (str and unicode) and Python 3
  ☆51Updated 9 years ago
• pydepta / pydepta
  A python implementation of DEPTA
  ☆83Updated 8 years ago
• zelandiya / maui
  ☆184Updated 6 years ago
• syllog1sm / redshift
  Transition-based statistical parser
  ☆416Updated 7 years ago
• zseymour / phrase2vec
  Implementation of phrase2vec from modified word2vec code.
  ☆94Updated 8 years ago