Alternatives and similar repositories for web-crawler

Users that are interested in web-crawler are comparing it to the libraries listed below

• linanqiu / omega-red
  Aggressive reddit scraper in node js
  ☆14Updated 10 years ago
• mhbuehler / resume-optimizer
  NLP tool for optimizing a resume for a job description, computing similarity, and extracting skills
  ☆16Updated 8 years ago
• JihoChoi / social-network-analysis-papers
  👥 Social Network Analysis Papers
  ☆65Updated 4 months ago
• agonzalezro / python-opensubtitles
  A python wrapper for the opensubtitles API
  ☆153Updated 4 years ago
• hridaydutta123 / awesome-twitter-tools
  A curated list of awesome twitter tools
  ☆228Updated 2 years ago
• rmax / scrapy-boilerplate
  Small set of utilities to simplify writing Scrapy spiders.
  ☆49Updated 10 years ago
• kevgathuku / tmdbwrapper
  Python API Wrapper for themoviedb.org's API
  ☆19Updated 5 years ago
• Ashwin-Ravi / NLP-Keyword-Extraction-Ensemble-Method
  This script uses an ensemble of multiple methods: RAKE, TF-IDF and Automatic Keyword Extraction to obtain top keywords in Reddit posts. P…
  ☆12Updated 8 years ago
• Shikhargupta / Smart-Highways-Internet-of-Things
  Real time monitoring of highways
  ☆20Updated 9 years ago
• scrapinghub / autopager
  Detect and classify pagination links
  ☆15Updated 5 years ago
• ajaybhat / email-categorization
  A Flask webapp that categorizes Outlook emails using machine learning
  ☆15Updated 10 years ago
• OmarEinea / GoodReadsScraper
  A GoodReads.com Scraper script to get books reviews including text and rating.
  ☆44Updated 3 years ago
• evagian / Document-similarity-K-shingles-minhashing-LSH-python
  ☆32Updated 8 years ago
• CNuge / email-report
  A modular template for scraping data from the web to send yourself scheduled email reports
  ☆41Updated 5 years ago
• volfpeter / localclustering
  Python 3 implementation and documentation of the Hermina-Janos local graph clustering algorithm.
  ☆24Updated 3 years ago
• anuragrana / scraping_tweets_celery_rabbitmq_docker_cluster
  Scraping tweets quickly using celery, RabbitMQ and Docker cluster
  ☆50Updated 3 years ago
• david1707 / scrapy_tutorial
  A Scrapy bot that I'm using to scrape 'http://books.toscrape.com/' URL for my tutorial on http://letslearnabout.net/
  ☆16Updated 6 years ago
• Abhishekmamidi123 / Natural-Language-Processing
  Language Modelling, CMI vs Perplexity
  ☆11Updated 7 years ago
• Kyziridis / PyPiano
  Piano sounds with GUI in python
  ☆12Updated 7 years ago
• rohithramesh1991 / Unsupervised-Text-Clustering
  ☆26Updated last year
• ankitjain28may / wifiPassword
  It gives the password of your connected wifi's
  ☆51Updated 4 years ago
• shobeir / GraphiPy
  GraphiPy: Universal Social Data Extractor
  ☆83Updated 3 years ago
• DusanMadar / ScrapeMeAgain
  Yet another Python web scraping application
  ☆29Updated 6 years ago
• johnbumgarner / newshound
  This Python package can be used to systematically extract multiple data elements (e.g., title, keywords, text) from news sources around t…
  ☆34Updated 2 years ago
• eldinsahbaz / TwitterBotDetection
  Differentiating between Twitter bots and real users
  ☆10Updated 7 years ago
• mulhod / reviewer_experience_prediction
  System for scraping video game review data from Steam and analyzing the data in terms of NLP features and other attributes, such as hours…
  ☆26Updated 9 years ago
• aayush210789 / Deception-Detection-on-Amazon-reviews-dataset
  A SVM model that classifies the reviews as real or fake. Used both the review text and the additional features contained in the data set …
  ☆55Updated 7 years ago
• jabraunlin / reddit-user-id
  ☆79Updated 7 years ago
• verifid / ner-d
  Python module for Named Entity Recognition (NER) using natural language processing.
  ☆13Updated 4 years ago
• isaacmg / fb_scraper
  FBLYZE is a Facebook scraping system and analysis system.
  ☆67Updated 4 years ago