furqanshahid85-python / Python-FTP-File-IngestionLinks
This module provides the functionality of uploading files to s3 from a FTP server. An SFTP connection is created with the FTP server and all the files present in the specified directory are uploaded to the specified s3 bucket. Following are the key features of this module: Creates a secure ssh connection with FTP server. Handles multipart upload…
☆13Updated 5 years ago
Alternatives and similar repositories for Python-FTP-File-Ingestion
Users that are interested in Python-FTP-File-Ingestion are comparing it to the libraries listed below
Sorting:
- Example DAGs using hooks and operators from Airflow Plugins☆346Updated 7 years ago
- This is the documentation for the Amazon Redshift Developer Guide☆121Updated 2 years ago
- Snowflake Cookbook, published by Packt☆80Updated 2 years ago
- Sample pytest tests for testing SQL Server assests.☆46Updated 6 years ago
- Airflow ETL for Meetup API☆45Updated 6 years ago
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…☆90Updated 3 years ago
- (project & tutorial) dag pipeline tests + ci/cd setup☆88Updated 4 years ago
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆169Updated last year
- Resources for video demonstrations and blog posts related to DataOps on AWS☆181Updated 3 years ago
- Example repo to create end to end tests for data pipeline.☆25Updated last year
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆110Updated last week
- A curated list of resources about Snowflake☆240Updated last year
- Airflow training for the crunch conf☆105Updated 6 years ago
- This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…☆92Updated 6 years ago
- A Python API for Asynchronously Loading Data into Snowflake DB -☆67Updated last month
- ☆186Updated 4 years ago
- ☆179Updated 2 years ago
- This repo contains DAGs demonstrating a variety of ELT patterns using Airflow along with dbt.☆13Updated 2 years ago
- Tracking and measuring neighborhood and district-level eviction rates in the city of San Francisco.☆139Updated 5 years ago
- The easiest way to run Airflow locally, with linting & tests for valid DAGs and Plugins.☆257Updated 4 years ago
- ☆60Updated 2 months ago
- Redshift Python Connector. It supports Python Database API Specification v2.0.☆215Updated last month
- Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…☆41Updated 3 years ago
- ☆62Updated 3 years ago
- Data Modeling with Snowflake, published by Packt☆66Updated 4 months ago
- A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract d…☆24Updated 3 years ago
- A complete development environment setup for working with Airflow☆127Updated 2 years ago
- A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …☆137Updated 5 years ago
- Code for dbt tutorial☆159Updated 2 months ago
- Source Code Collection and Supplemental Material for the O'Reilly Snowflake Definitive Guide 1st Edition book☆101Updated 2 years ago