smeeklai / chrome-selenium-scrapy
Ready to run python 3.6.4 docker image with chrome, selenium and scrapy installed
☆11Updated 6 years ago
Related projects ⓘ
Alternatives and complementary repositories for chrome-selenium-scrapy
- How to do data science with Optimus, Spark and Python.☆18Updated 5 years ago
- ☆16Updated 8 years ago
- Ingest tweets with Kafka. Use Spark to track popular hashtags and trendsetters for each hashtag☆29Updated 8 years ago
- High Level Kafka Scanner☆19Updated 7 years ago
- ☆15Updated 8 years ago
- Base project for creating Python Apache Beam pipelines and running them in Google DataFlow using CRON scheduler☆23Updated 7 years ago
- boilerplate code to start with celery and rabbitmq in docker cluster☆19Updated last year
- Trolling Detection PoC with NLTK and scikit-learn☆19Updated last year
- Chatlytics is a data query and visualization platform for chat!☆13Updated 7 years ago
- ☆13Updated last year
- Slack notifications for the Luigi workflow manager☆46Updated 3 years ago
- Real time and offline time series analysis with Spark, Spark Streaming and Storm☆21Updated 4 years ago
- Airflow code accompanying blog post.☆21Updated 5 years ago
- Streaming pipeline repo for data engineering training program☆9Updated 5 years ago
- Query, analysis, and visualization of large video collections☆9Updated last year
- ☆26Updated 3 years ago
- A cookiecutter template for Apache Spark applications written in Scala☆10Updated 5 years ago
- Orchestrate web crawlers to create structured datasets from multiple data sources with YAML configs.☆14Updated last year
- A small Python module containing quick utility functions for standard ETL processes.☆33Updated last week
- A collection of datasets and databases☆24Updated 6 years ago
- ☆19Updated 7 years ago
- This repo demonstrates how to load a sample Parquet formatted file from an AWS S3 Bucket. A python job will then be submitted to a Apach…☆19Updated 8 years ago
- A library for sending software performance metrics from Python libraries and apps to statsd.☆30Updated 5 months ago
- Docker image for python datascience container with NumPy, SciPy, Scikit-learn, Matplotlib, nltk, pandas packages installed.☆48Updated 5 years ago
- ☆15Updated 8 years ago
- Python bindings for Matroid API☆16Updated last month
- Scrapy extension which writes crawled items to Kafka☆30Updated 6 years ago
- Docker compose files for various kafka stacks☆33Updated 6 years ago