Recursive list folder
- operators.sys.recursive_list_folder(client, folder_target='/folder_target', folder_destination='/folder_destination', worker_instance_type='x2large', manager_instance_type='small', extension_target='.laz', extension_destination='.txt', skip_existing_files=False)
- recursive_list_folder(client,target=’/target’,destination=’/destination’,worker_instance_type=’x2large’,manager_instance_type=”small”,extension_target=”.target/”,extension_destination=”.txt”,skip_existing_files = False )
- Parameters:
folder_target – Target folder to be listed recursively
folder_destination – Output folder
worker_instance_type – cloud instance type of worker nodes
manager_instance_type – cloud instance type of manager node
extension_target – File extension of files in folder for folder_target
extension_destination – File extension of files in folder for folder_destination
skip_existing_files – skip files that already exist in the output folder