This module provides the functionality of uploading files to s3 from a FTP server. An SFTP connection is created with the FTP server and all the files present in the specified directory are uploaded to the specified s3 bucket. Following are the key features of this module: Creates a secure ssh connection with FTP server. Handles multipart upload…
☆13May 9, 2020Updated 6 years ago
Alternatives and similar repositories for Python-FTP-File-Ingestion
Users that are interested in Python-FTP-File-Ingestion are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16Jun 27, 2020Updated 5 years ago
- Using Apache Airflow to author, run and monitor complex data pipelines.☆12Oct 24, 2018Updated 7 years ago
- light wrapper for indeed.com api☆16Oct 30, 2016Updated 9 years ago
- ☆11Oct 11, 2022Updated 3 years ago
- A Gentle introduction to Machine Learning with Apache Spark☆11Mar 2, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Big Data's open seminars: An Interactive Introduction to Reinforcement Learning☆14Nov 21, 2017Updated 8 years ago
- Data fetched from the USGS Earthquake Archives☆13Jun 21, 2017Updated 8 years ago
- A set of widgets for Python's Orange Machine Learning to work with Apache Spark ML☆15Dec 24, 2016Updated 9 years ago
- ☆12Oct 16, 2023Updated 2 years ago
- Optimizing downstream data processing with Amazon Kinesis Data Firehose and Amazon EMR running Apache Spark☆14Apr 14, 2023Updated 3 years ago
- The Demo for Blog: Modularization using Python and Docker (MicroService)☆12Feb 4, 2021Updated 5 years ago
- Basic Spark utilities☆13Feb 20, 2025Updated last year
- A pyspark lib to validate data quality☆19Nov 11, 2022Updated 3 years ago
- This is a mirror of https://github.com/LucaCanali/sparkMeasure - sparkMeasure is a tool for performance troubleshooting of Apache Spark w…☆16Oct 3, 2025Updated 7 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Easy access of environment variables from Python with support for typing (ex. booleans, strings, lists, tuples, integers, floats, and dic…☆26Jun 28, 2023Updated 2 years ago
- Example to create lineage in Atlas with sqoop and spark☆14Apr 5, 2017Updated 9 years ago
- Repo for holding the dbt project used to make sense of cloud cost data from the major cloud platforms☆38Mar 1, 2020Updated 6 years ago
- Tools for faster and optimized interaction with Teradata and large datasets.☆17Jul 11, 2018Updated 7 years ago
- Rocksdb state storage implementation for Structured Streaming.☆17Oct 21, 2020Updated 5 years ago
- Thoughts on things I find interesting.☆17Dec 19, 2024Updated last year
- Capstone Project for General Assembly's Data Science Immersive Course☆13May 8, 2017Updated 9 years ago
- This is a fork of the Apache Flink Kinesis connector adding Enhanced Fanout support for Flink 1.8/1.11 on KDA.☆24Mar 1, 2026Updated 2 months ago
- curated list of awesome open source repositories for data pipelining and machine learning in production.☆17Dec 1, 2019Updated 6 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆20Feb 14, 2018Updated 8 years ago
- ☆23Oct 3, 2024Updated last year
- SQL problems with solution & summary☆12May 2, 2021Updated 5 years ago
- The kubectl plugin which allows us to test IRSA configuration AWS sa☆23Nov 2, 2022Updated 3 years ago
- Blog post on ETL pipelines with Airflow☆23Aug 31, 2025Updated 8 months ago
- Amazon EMR on EKS Custom Image CLI☆32Sep 26, 2024Updated last year
- AWS Automation boto3 scripts☆57Aug 14, 2019Updated 6 years ago
- A toolset to streamline running spark python on EMR☆20Nov 16, 2016Updated 9 years ago
- Django generic marketplace API☆11Jun 10, 2020Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Multi-stage, config driven, SQL based ETL framework using PySpark☆26Sep 16, 2019Updated 6 years ago
- A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract d…☆24Nov 22, 2021Updated 4 years ago
- An opinionated Kafka producer/consumer built on top of confluent-kafka-python/librdkafka☆28Apr 23, 2026Updated last month
- ☆31Oct 31, 2018Updated 7 years ago
- Notebooks which will provide a demo of Qgrid functionality☆20Jan 16, 2020Updated 6 years ago
- Tax-Brain is an integrator model for PSL tax models☆13Apr 13, 2026Updated last month
- Cloud based Data Platform based on Apache Spark☆28Updated this week