Creates a pipeline Airflow and Scrapy to output an average image composition of everyone's face in a given website
☆43Oct 13, 2017Updated 8 years ago
Alternatives and similar repositories for airflow-averageface
Users that are interested in airflow-averageface are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.☆76Mar 18, 2022Updated 4 years ago
- Scrapy extension which writes crawled items to Kafka☆31Apr 8, 2026Updated 2 months ago
- ☆17Jan 30, 2016Updated 10 years ago
- Scrapy example project using Tor (through Privoxy) in a Docker Compose multi-container application☆11Oct 28, 2017Updated 8 years ago
- ☆34Feb 27, 2013Updated 13 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- PEP8 Tests to Django projects☆12Nov 28, 2012Updated 13 years ago
- 🕶 Awesome list of Scrapy tools and libraries☆60Jul 6, 2020Updated 6 years ago
- LODmilla - a graph-based Linked Open Data browser☆18Jun 14, 2026Updated 3 weeks ago
- A simple example to show how to run background tasks with FLask and RQ☆24Aug 21, 2016Updated 9 years ago
- Vitro editor for library cataloging☆11Jun 29, 2018Updated 8 years ago
- A CLI for benchmarking Scrapy.☆32Jun 28, 2025Updated last year
- Yandex.Phone kernel sources☆18Jan 17, 2019Updated 7 years ago
- ☆13Jul 31, 2018Updated 7 years ago
- ☆15Dec 18, 2020Updated 5 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ScrapyDemo : Redis MySQLdb logging IngoreHttpRequestMiddleware UserAgentMiddleware HttpProxyMiddleware rules☆38Jun 28, 2016Updated 10 years ago
- Tasky is a lite version of Google Calendar that allows users to create, view, edit, and delete events, tasks, and reminders. It works as …☆14Sep 13, 2024Updated last year
- Integrate hookbox with Django☆19Nov 5, 2011Updated 14 years ago
- Render resources described in RDF using logicless templates.☆15Dec 30, 2022Updated 3 years ago
- Data-Science-Projects-in-Python☆11Jul 25, 2018Updated 7 years ago
- Monitoring Traefik with grafana and Prometheus☆11Feb 22, 2020Updated 6 years ago
- Park Locator is a mapping tool for Raleigh parks that allows you to find the closest park to your home, search for parks by amenity, get …☆10May 25, 2016Updated 10 years ago
- Python script for importing DBpedia nodes and relationships into Neo4j☆14Mar 15, 2014Updated 12 years ago
- Distributed crawling/scraping, Kafka And Redis based components for Scrapy☆46Nov 13, 2020Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 分布式爬虫框架,基于webdrvier模拟用户请求,kafka消息传递,分布式网页存储使用hbase,task异步任务多线程解析,提供基础服务如:proxy ip服务和号码验证服务等, proxy page使用H5和we版进行接入☆13Dec 18, 2015Updated 10 years ago
- Modern machine learning and statistical toolbox for financial researchers and practitioners☆12Jul 14, 2023Updated 2 years ago
- 🧙 LDWizard: A generic framework for simplifying the creation of linked data. Supported by the PLDN community.☆18May 27, 2024Updated 2 years ago
- A repository for the AI2D-RST corpus.☆18Jul 2, 2024Updated 2 years ago
- Mock alert stream distribution system using Kafka producers and consumers.☆13Nov 29, 2023Updated 2 years ago
- ☆11Nov 21, 2022Updated 3 years ago
- This repo contains code for a web application that allows users to view SEC Filing data.☆53Oct 17, 2021Updated 4 years ago
- Source code and software for converting QTI version 1.x data into QTI 2.0 content packages.☆16Mar 23, 2026Updated 3 months ago
- 🦄 Instant notification about any changes from decentralized world straight to you (newly added tokens, whales movements, token transfers…☆15Jan 18, 2021Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Fast small desktop and web application designed to provide a visual interactive representation of RDF (Resource Description Framework) da…☆46Jun 11, 2026Updated 3 weeks ago
- Standalone repo for Mobius Wallet☆13Dec 8, 2022Updated 3 years ago
- Building Event Driven Application with AWS Lambda and Amazon Redshift Data API☆17Oct 27, 2020Updated 5 years ago
- scrapy爬取美团大众点评饭店数据☆17Jun 11, 2017Updated 9 years ago
- Mock server plugin for pytest☆27May 17, 2022Updated 4 years ago
- Fast / fuzzy PostgreSQL counts for Django☆90Jan 6, 2023Updated 3 years ago
- [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.☆12Apr 8, 2026Updated 2 months ago