Alternatives and similar repositories for trawler:

Users that are interested in trawler are comparing it to the libraries listed below

• Parsely / birding
  Stream processing in Python of twitter searches using public APIs.
  ☆9Updated 9 years ago
• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated 8 months ago
• rmax / scrapy-boilerplate
  Small set of utilities to simplify writing Scrapy spiders.
  ☆49Updated 9 years ago
• istresearch / traptor
  Traptor -- A distributed Twitter feed
  ☆26Updated 2 years ago
• TeamHG-Memex / scrapy-kafka-export
  Scrapy extension which writes crawled items to Kafka
  ☆30Updated 6 years ago
• scrapy / xtractmime
  https://mimesniff.spec.whatwg.org/ implementation for Python
  ☆14Updated last year
• TeamHG-Memex / autologin-middleware
  Scrapy middleware for the autologin
  ☆37Updated 6 years ago
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 6 years ago
• TeamHG-Memex / scrapy-dockerhub
  [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.
  ☆11Updated 9 years ago
• TeamHG-Memex / fortia
  [UNMAINTAINED] Firefox addon for Scrapely
  ☆5Updated 9 years ago
• faridani / PyNLP
  ... just because nltk is too heavy
  ☆35Updated 14 years ago
• trec-kba / streamcorpus-pipeline
  framework for making streamcorpus data
  ☆11Updated 7 years ago
• Lab41 / SkyLine
  An Exploration into Graph Databases
  ☆28Updated 9 years ago
• mattmakai / slack-api-python-examples
  Python code examples for working with the Slack API. 2.x and 3.x compatible code.
  ☆13Updated 8 years ago
• Lab41 / Redwood
  A project that implements statistical methods for identifying anomalous files
  ☆22Updated 10 years ago
• duo-labs / tutorials
  ☆15Updated 6 years ago
• jeffknupp / domain-parser
  Parse domains using the TLD list maintained by publicsuffix.org
  ☆61Updated 4 years ago
• scrapinghub / flatson
  Tool to flatten stream of JSON-like objects, configured via schema
  ☆33Updated 5 years ago
• cdunklau / fbemissary
  A bot framework for the Facebook Messenger platform, built on asyncio and aiohttp
  ☆30Updated 7 years ago
• yasikstudio / devrank
  The DeveloperRank is analysis project developer's rank on Github. We are inspired by the PageRank.
  ☆12Updated 9 years ago
• berdario / resumable-urlretrieve
  Small library to fetch files over HTTP and resuming their download
  ☆13Updated 3 years ago
• pudo / banal
  Commons of stupid, simple Python micro functions. Pull requests very welcome.
  ☆19Updated 2 years ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• pawamoy / django-meerkat
  Security audit tool for Django sites
  ☆14Updated 3 months ago
• appsecco / docker-data-science-toolbox
  Data Science Command Line Toolbox in a docker container
  ☆28Updated 6 years ago
• kodiaklabs / MovieSentimentClassification
  A brief tutorial on NLP via sentiment classification, Jupyter notebooks, feature creation, and exploritory data analysis.
  ☆25Updated 6 years ago
• harshulj / tweetlake
  Tweet Lake is a commandline interface to Twitter Streaming API and big data project that extracts interesting stats out of tweet corpus.
  ☆20Updated 2 years ago
• ceteri / slinky
  Slinky, a high-performance web crawler / text analytics in Python, Redis, Hadoop, R, Gephi
  ☆41Updated 14 years ago
• scrapy-plugins / scrapy-streaming
  ☆18Updated 8 years ago
• Datamine / Function-Profiler
  Python 3.6 Module to Profile Function Performance in Production
  ☆16Updated 8 years ago