Example of using Airflow to schedule downloading data form S3 and launching spark jobs
☆15Oct 17, 2016Updated 9 years ago
Alternatives and similar repositories for airflow-pyspark-reddit
Users that are interested in airflow-pyspark-reddit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Dendriform di-algebra algorithms to compute using Loday's arithmetic on groves of planar binary trees☆16Dec 7, 2019Updated 6 years ago
- Find first derivatives of functions automagically☆10Feb 21, 2017Updated 9 years ago
- Code base for the Coding Dojo Skill☆23Jan 30, 2018Updated 8 years ago
- Lambda curator is a lambda function deletes old AWS ElasticSearch indices using curator.☆13Nov 12, 2019Updated 6 years ago
- This repo demonstrates how to load a sample Parquet formatted file from an AWS S3 Bucket. A python job will then be submitted to a Apach…☆19Jun 23, 2016Updated 9 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- minimal crawlers for scraping recipes from various recipe sites☆11Aug 27, 2013Updated 12 years ago
- Apache Spark on Apache Yarn 2.6.0 cluster Docker image☆11Oct 18, 2017Updated 8 years ago
- Run docker-gc regularly under a cron job within a Docker container☆12Sep 29, 2017Updated 8 years ago
- tiny flask app for viewing images with catalogs☆33Feb 20, 2022Updated 4 years ago
- A package for managing a static, mathematically-inclined web log☆27Oct 3, 2015Updated 10 years ago
- A Docker image for Livy, the REST Spark Server☆15Jun 20, 2016Updated 9 years ago
- expand specific aliases with space☆15Mar 10, 2017Updated 9 years ago
- An interpreter for Gödel's System T☆13Apr 17, 2017Updated 8 years ago
- Creates a counting system of radixes such as base 12 or mixed radixes such as Minutes/Hours/Days/Years (60/60/24/365)☆13May 8, 2019Updated 6 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆17Sep 24, 2016Updated 9 years ago
- Arithmetica is a reusable platform to democratize the computation and data availability of computational math problems.☆17Jun 21, 2018Updated 7 years ago
- Apuntes de las asignaturas de matemáticas en la UGR☆16Jan 14, 2018Updated 8 years ago
- My attempt to better understand both Coq and Category Theory by formalizing the latter in the former.☆14Aug 3, 2019Updated 6 years ago
- Python Files to be run from aws lambda to interact with Amazon Alexa :)☆36Apr 19, 2019Updated 6 years ago
- List of inspiring articles, blogs, tutorials and books. Tech stuff.☆14Nov 1, 2017Updated 8 years ago
- The Mathematics Concept Map is my attempt at reconstructing all the internal knowledge I've acquired about mathematics over the years.☆16Nov 28, 2019Updated 6 years ago
- A collection of notable optimization problems solved with AMPL.☆13Jul 29, 2017Updated 8 years ago
- ☆11Nov 27, 2015Updated 10 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Meta mathematics. Symbolic functions and derivatives.☆32May 3, 2018Updated 7 years ago
- Semantic Versioning routing for Koa☆19Nov 5, 2018Updated 7 years ago
- Notes on determinants and other concrete algebra (PRIMES 2015 reading project: problems and solutions)☆17Sep 15, 2022Updated 3 years ago
- Deploying a simple FastAPI app to Fly.io >> https://fly-fastapi.fly.dev/docs <<☆14Oct 2, 2023Updated 2 years ago
- Matrices.☆18Feb 20, 2020Updated 6 years ago
- Apple EPF crawler, downloader and parser☆15Jan 7, 2017Updated 9 years ago
- PySpark, Databrick, h2o, MLlib☆20Aug 25, 2016Updated 9 years ago
- Development fork for Monary (official is https://bitbucket.org/djcbeach/monary)☆17Mar 20, 2018Updated 8 years ago
- 一个简易版的定时任务后台管理器，基于Go语言和gin+grom框架开发。http://121.199.79.74:82/☆12Jun 28, 2020Updated 5 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- The DSP Cookbook☆23Oct 27, 2017Updated 8 years ago
- Python 3.6+ SSH Client for network devices built on ssh2-python☆12Apr 11, 2020Updated 5 years ago
- Homomorphic Encryption in Python☆20Jan 28, 2018Updated 8 years ago
- Terraform module for a PostgreSQL-backed Apache Airflow instance☆24May 16, 2018Updated 7 years ago
- It's a bit boring to wait for a long script to complete, so it'll be better if someone will wait with you!☆21Dec 3, 2017Updated 8 years ago
- @logicbot@mathstodon.xyz☆21Apr 15, 2023Updated 2 years ago
- Visualiser for basic geometric primitives and fractals in arbitrary-dimensional spaces☆43Mar 12, 2017Updated 9 years ago