Example of using Airflow to schedule downloading data form S3 and launching spark jobs
☆15Oct 17, 2016Updated 9 years ago
Alternatives and similar repositories for airflow-pyspark-reddit
Users that are interested in airflow-pyspark-reddit are comparing it to the libraries listed below
Sorting:
- This repo demonstrates how to load a sample Parquet formatted file from an AWS S3 Bucket. A python job will then be submitted to a Apach…☆19Jun 23, 2016Updated 9 years ago
- ☆11Jun 12, 2019Updated 6 years ago
- Kubernetes Container Storage Interface (CSI) plug-in for Oracle ZFS Storage Appliance.☆14Jul 2, 2024Updated last year
- Python 3.6+ SSH Client for network devices built on ssh2-python☆12Apr 11, 2020Updated 5 years ago
- Kubernetes Volume Snapshot Controller using Custom Resource Definition☆12Sep 20, 2017Updated 8 years ago
- Lambda curator is a lambda function deletes old AWS ElasticSearch indices using curator.☆13Nov 12, 2019Updated 6 years ago
- DRM Removal Helpers for purchased books☆13Dec 24, 2023Updated 2 years ago
- Advanced PDF parsing for python☆12Jan 21, 2025Updated last year
- Kafka plugin for KairosDB☆11Feb 28, 2018Updated 8 years ago
- RabbitMQ Cluster in Kubernetes using the rabbitmq-clusterer plugin☆12Dec 19, 2016Updated 9 years ago
- Dockerfile for a base Logstash image to be extended by others (allow to install plug-ins, change configuration, etc.)☆10Jan 16, 2017Updated 9 years ago
- Code shared between Linstor client and Linstor server☆10Updated this week
- Simple tool in Python to help monitoring ram/cpu/io usage around ceph.☆10Jul 29, 2016Updated 9 years ago
- Ceph Cookbook – Second Edition, published by Packt☆12Jan 14, 2021Updated 5 years ago
- minimal crawlers for scraping recipes from various recipe sites☆11Aug 27, 2013Updated 12 years ago
- Cloud Storage Kubernetes Operator with Go and Operator SDK☆12Nov 20, 2020Updated 5 years ago
- Simple library for working with passwords in Go (golang).☆13Feb 18, 2016Updated 10 years ago
- Find first derivatives of functions automagically☆10Feb 21, 2017Updated 9 years ago
- Kubernetes LDAP authentication service written in Go.☆10May 4, 2019Updated 6 years ago
- ☆15Sep 10, 2022Updated 3 years ago
- Privacy-preserving data sandbox for on-premise computation☆11Jun 15, 2021Updated 4 years ago
- A proposal for Helm 3 using CRDs and a custom controller☆13Mar 8, 2018Updated 8 years ago
- Using OPA Gatekeeper to deny admission or audit Istio and Istio-related objects☆12Nov 25, 2019Updated 6 years ago
- Errbot for Rocket.Chat - fork of unmaintained https://github.com/AoiKuiyuyou/AoikRocketChatErrbot☆12Feb 21, 2022Updated 4 years ago
- NVMesh Container Storage Interface (CSI) Driver for Kubernetes☆11Oct 7, 2024Updated last year
- Snapshot script for Ceph RBD and Samba vfs shadow_copy2☆15Feb 3, 2017Updated 9 years ago
- containerized NFS Ganesha daemon☆10Aug 15, 2016Updated 9 years ago
- Run Tensorflow and Keras with GPU support on Kubernetes☆13Mar 21, 2017Updated 8 years ago
- Kuberetes etcd network checkpointer☆11Jul 20, 2017Updated 8 years ago
- Personal expense tracking application☆10Nov 10, 2018Updated 7 years ago
- Template repository of a machine-learning Python project powered by FastAPI and PyTorch☆14Aug 26, 2021Updated 4 years ago
- Deploying a simple FastAPI app to Fly.io >> https://fly-fastapi.fly.dev/docs <<☆14Oct 2, 2023Updated 2 years ago
- Contrail Helm based deployment☆11Mar 24, 2022Updated 3 years ago
- An operator for managing Alluxio system on Kubernetes cluster☆13Jan 9, 2024Updated 2 years ago
- Dendriform di-algebra algorithms to compute using Loday's arithmetic on groves of planar binary trees☆16Dec 7, 2019Updated 6 years ago
- A set of scripts to back up data to one or more servers using rsync and automatically create/expire zfs snapshots of the backups☆15Apr 15, 2024Updated last year
- Multi-site Network Emulation, Kubeadm-installed Kubernetes, NVMe over Fabrics☆18Feb 8, 2021Updated 5 years ago
- common go code☆14Feb 22, 2021Updated 5 years ago
- Custom Service for deploying Apache Alluxio on a running HDP 2.3 / IOP 4.1 Ambari Managed Cluster☆13Jan 13, 2017Updated 9 years ago