Download data to cloud folder
- operators.sys.download_data_to_cloud_folder(client, url='', folder_destination='/folder_destination', protocol='', download_type=0, username='', password='', port=21, worker_instance_type='x2large', manager_instance_type='small', extension_destination='.laz', skip_existing_files=False)
- download_data_to_cloud_folder(client,url=’’,destination=’/destination’,protocol=’’,download_type=0,username=’’,password=’’,port=21,worker_instance_type=’x2large’,manager_instance_type=”small”,extension_destination=”.data”,skip_existing_files = False )
- Parameters:
url – URL to data
protocol – protocol: : automatically try to infer protocol, ftp: ftp, sftp: sftp
download_type – download type: 0: all files from folder, 1: individual file
username – Username
password – Password
port – port
folder_destination – Destionation location on host. default folder: ./data
worker_instance_type – cloud instance type of worker nodes
manager_instance_type – cloud instance type of manager node
extension_destination – File extension of files in folder for folder_destination
skip_existing_files – skip files that already exist in the output folder