Alternatives and similar repositories for trawler

Users that are interested in trawler are comparing it to the libraries listed below

• rmax / scrapy-boilerplate
  Small set of utilities to simplify writing Scrapy spiders.
  ☆49Updated 9 years ago
• Parsely / birding
  Stream processing in Python of twitter searches using public APIs.
  ☆9Updated 9 years ago
• TeamHG-Memex / autologin-middleware
  Scrapy middleware for the autologin
  ☆37Updated 7 years ago
• TeamHG-Memex / scrapy-kafka-export
  Scrapy extension which writes crawled items to Kafka
  ☆30Updated 6 years ago
• istresearch / traptor
  Traptor -- A distributed Twitter feed
  ☆26Updated 2 years ago
• cdunklau / fbemissary
  A bot framework for the Facebook Messenger platform, built on asyncio and aiohttp
  ☆30Updated 8 years ago
• harshulj / tweetlake
  Tweet Lake is a commandline interface to Twitter Streaming API and big data project that extracts interesting stats out of tweet corpus.
  ☆20Updated 2 years ago
• MartinPaulEve / PlotSummary
  Plots various graphs for a series of plaintext files in a directory
  ☆19Updated 9 years ago
• duckworthd / mirai
  Twitter Futures for Python
  ☆58Updated 10 years ago
• horia141 / sdhash
  Python library for image hashing and deduplication
  ☆11Updated 9 years ago
• atmb4u / butler
  Python Dictionaries and Lists on Steroids
  ☆23Updated 10 years ago
• TeamHG-Memex / scrapy-dockerhub
  [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.
  ☆11Updated 10 years ago
• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated last year
• faridani / PyNLP
  ... just because nltk is too heavy
  ☆35Updated 14 years ago
• pawamoy / django-meerkat
  Security audit tool for Django sites
  ☆14Updated last week
• trec-kba / streamcorpus
  common data interchange format for document processing pipelines that apply natural language processing tools to large streams of text
  ☆35Updated 8 years ago
• trec-kba / streamcorpus-pipeline
  framework for making streamcorpus data
  ☆11Updated 8 years ago
• juanpabloaj / runmultithread
  Run the same process with different inputs in different threads
  ☆15Updated 8 years ago
• mattmakai / slack-api-python-examples
  Python code examples for working with the Slack API. 2.x and 3.x compatible code.
  ☆13Updated 9 years ago
• nylas / nylas-production-python
  Utilities for running Python code in production
  ☆18Updated 7 years ago
• jeffknupp / domain-parser
  Parse domains using the TLD list maintained by publicsuffix.org
  ☆61Updated 4 years ago
• Muterra / py_smartyparse
  Smartyparse: A python library for smart dynamic binary de/encoding.
  ☆15Updated 7 years ago
• scrapy / pypydispatcher
  A fork of http://pydispatcher.sourceforge.net/ with PyPy support
  ☆16Updated 7 years ago
• mhl / unicode-poster
  Scripts for generating posters that contain glyphs of every printable character in Unicode 5.1.0
  ☆23Updated 14 years ago
• collinalexbell / Email-Autoresponder
  ☆21Updated 10 years ago
• itmaster921 / monitoring
  Server monitoring and data-collection daemon
  ☆10Updated 6 years ago
• benoitc / flower
  collection of modules to build distributed and reliable concurrent systems in Python.
  ☆205Updated 11 years ago
• TeamHG-Memex / url-summary
  Show summary of a large number of URLs in a Jupyter Notebook
  ☆17Updated 4 years ago
• TeamHG-Memex / extract-html-diff
  extract difference between two html pages
  ☆32Updated 7 years ago
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 7 years ago