Recursive list folder

operators.sys.recursive_list_folder(client, folder_target='/folder_target', folder_destination='/folder_destination', worker_instance_type='x2large', manager_instance_type='small', extension_target='.laz', extension_destination='.txt', skip_existing_files=False)

recursive_list_folder(client,
target=’/target’,
destination=’/destination’,
worker_instance_type=’x2large’,
manager_instance_type=”small”,
extension_target=”.target/”,
extension_destination=”.txt”,
skip_existing_files = False )
Parameters:
  • folder_target – Target folder to be listed recursively

  • folder_destination – Output folder

  • worker_instance_type – cloud instance type of worker nodes

  • manager_instance_type – cloud instance type of manager node

  • extension_target – File extension of files in folder for folder_target

  • extension_destination – File extension of files in folder for folder_destination

  • skip_existing_files – skip files that already exist in the output folder