Select corresponding path folder
- operators.sys.select_corresponding_path_folder(client, original_folder='/original_folder', original_identifier_folder='/original_identifier_folder', corresponding_folder='/corresponding_folder', output_folder='/output_folder', selection_criteria='oldest', default_value='__original__', worker_instance_type='x2large', manager_instance_type='small', extension_original_file='.txt', extension_original_identifier_file='.txt', extension_corresponding_file='.txt', extension_output_file='.txt', skip_existing_files=False)
- select_corresponding_path_folder(client,original_folder=’/original_folder’,original_identifier_folder=’/original_identifier_folder’,corresponding_folder=’/corresponding_folder’,output_folder=’/output_folder’,selection_criteria=’oldest’,default_value=’__original__’,worker_instance_type=’x2large’,manager_instance_type=”small”,extension_original_folder=”.txt”,extension_original_identifier_folder=”.txt”,extension_corresponding_folder=”.txt”,extension_output_folder=”.txt”,skip_existing_files = False )
- Parameters:
selection_criteria – selection criteria: [oldest, newest, shortest, longest]
default_value – default value if no corresponding path is found
original_folder – original folders
original_identifier_folder – original identifiers
corresponding_folder – corresponding folders
output_folder – output folder
worker_instance_type – cloud instance type of worker nodes
manager_instance_type – cloud instance type of manager node
extension_original_folder – File extension of files in folder for original_folder
extension_original_identifier_folder – File extension of files in folder for original_identifier_folder
extension_corresponding_folder – File extension of files in folder for corresponding_folder
extension_output_folder – File extension of files in folder for output_folder
skip_existing_files – skip files that already exist in the output folder