scribd / objinsyncLinks
Continuously synchronize directories from remote object store to local filesystem
☆108Updated this week
Alternatives and similar repositories for objinsync
Users that are interested in objinsync are comparing it to the libraries listed below
Sorting:
- Airflow Executor for both AWS ECS & AWS Fargate☆52Updated 2 years ago
- Prometheus Exporter for Airflow☆161Updated last year
- Pylint plugin for static code analysis on Airflow code☆96Updated 5 years ago
- Fast iterative local development and testing of Apache Airflow workflows☆202Updated 3 months ago
- The Amazon S3 Tables catalog is a client library that bridges control plane operations provided by S3 Tables to engines like Apache Spark…☆142Updated 3 months ago
- Spark ETL example processing New York taxi rides public dataset on EKS☆44Updated 2 years ago
- AWS Glue Schema Registry Client library provides serializers / de-serializers for applications to integrate with AWS Glue Schema Registry…☆145Updated last month
- A CLI to manage and monitor permissions in AWS Lake Formation☆25Updated 2 years ago
- Spark runtime on AWS Lambda☆113Updated 3 months ago
- 🐋 Docker image for AWS Glue Spark/Python☆23Updated 2 years ago
- Deploy Presto on the cloud easily, using Terraform and Packer☆45Updated 2 years ago
- Web UI for Amazon Athena☆58Updated 3 years ago
- ETLy is an add-on dashboard service on top of Apache Airflow.☆68Updated 2 years ago
- Airflow plugin to export dag and task based metrics to Prometheus.☆269Updated last month
- ☆44Updated 2 months ago
- A one-afternoon implementation of redis-like primitives with S3 Express☆33Updated last year
- Sample code to collect Apache Iceberg metrics for table monitoring☆29Updated last year
- Amazon EMR on EKS Custom Image CLI☆31Updated last year
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆39Updated 9 months ago
- Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker…☆84Updated 2 years ago
- A terraform module that creates an airflow instance in AWS ECS.☆60Updated 2 years ago
- Auto-generated Diagrams from Airflow DAGs. 🔮 🪄☆353Updated last week
- Repository of helm charts for deploying DataHub on a Kubernetes cluster☆196Updated last week
- Airflow declarative DAGs via YAML☆133Updated 2 years ago
- ☆30Updated last year
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆77Updated 7 years ago
- Serverless multi-protocol + multi-destination event collection system.☆209Updated last year
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆259Updated 2 years ago
- Airflow Providers containing Deferrable Operators & Sensors from Astronomer☆149Updated last week
- A Helm chart to install Apache Airflow on Kubernetes☆290Updated last week