charman / trawler

Related projects ⓘ

Alternatives and complementary repositories for trawler

• TeamHG-Memex / autologin-middleware
  Scrapy middleware for the autologin
  ☆37Updated 6 years ago
• Parsely / birding
  Stream processing in Python of twitter searches using public APIs.
  ☆9Updated 8 years ago
• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated 6 months ago
• istresearch / traptor
  Traptor -- A distributed Twitter feed
  ☆26Updated 2 years ago
• TeamHG-Memex / scrapy-kafka-export
  Scrapy extension which writes crawled items to Kafka
  ☆30Updated 6 years ago
• cdunklau / fbemissary
  A bot framework for the Facebook Messenger platform, built on asyncio and aiohttp
  ☆30Updated 7 years ago
• juanpabloaj / runmultithread
  Run the same process with different inputs in different threads
  ☆15Updated 8 years ago
• xhresko / text-summarizer
  Simple program that summarize text.
  ☆10Updated 14 years ago
• TeamHG-Memex / scrapy-dockerhub
  [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.
  ☆11Updated 9 years ago
• trec-kba / streamcorpus
  common data interchange format for document processing pipelines that apply natural language processing tools to large streams of text
  ☆34Updated 8 years ago
• pawamoy / django-meerkat
  Security audit tool for Django sites
  ☆14Updated last month
• beeware / slick
  A native web-based client for Slack.
  ☆23Updated 7 years ago
• rmax / scrapy-boilerplate
  Small set of utilities to simplify writing Scrapy spiders.
  ☆49Updated 9 years ago
• jaysw / ipydb
  Turn your IPython console into a cross-database SQL client
  ☆31Updated 8 years ago
• harshulj / tweetlake
  Tweet Lake is a commandline interface to Twitter Streaming API and big data project that extracts interesting stats out of tweet corpus.
  ☆20Updated 2 years ago
• mattmakai / slack-api-python-examples
  Python code examples for working with the Slack API. 2.x and 3.x compatible code.
  ☆13Updated 8 years ago
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 6 years ago
• kodiaklabs / MovieSentimentClassification
  A brief tutorial on NLP via sentiment classification, Jupyter notebooks, feature creation, and exploritory data analysis.
  ☆25Updated 6 years ago
• vforgione / logging2
  A More Pythonic Logging System
  ☆21Updated 4 years ago
• datalib / StatsCounter
  Python's missing statistical Swiss Army knife
  ☆15Updated 9 years ago
• scrapinghub / docker-images
  ☆32Updated 10 months ago
• lorien / selection
  API to extract data from HTML and XML documents
  ☆9Updated last year
• trec-kba / streamcorpus-pipeline
  framework for making streamcorpus data
  ☆11Updated 7 years ago
• TeamHG-Memex / url-summary
  Show summary of a large number of URLs in a Jupyter Notebook
  ☆17Updated 3 years ago
• uber / py-look-for-timeouts
  Scan for missing timeout calls in python source files
  ☆18Updated 4 years ago
• scrapinghub / kafka-scanner
  High Level Kafka Scanner
  ☆19Updated 7 years ago
• Linkurious / PyLinkurious
  Linkurious.js integration with Jupyter notebooks
  ☆10Updated 7 years ago
• sYnfo / Yasuf
  Very simple way of controlling your Python application via Slack
  ☆22Updated 8 years ago