Upload from aipha to s3 folder
- operators.sys.upload_from_aipha_to_s3_folder(client, access_key_id='YOUR_KEY_ID', secret_access_key='YOUR_SECRET_KEY', aws_region='eu-central-1', folder_target='/folder_target', location='file.laz', bucket_name='Your S3 bucket', worker_instance_type='x2large', manager_instance_type='small', extension_target='.laz', skip_existing_files=False)
- Upload a path to a S3 bucket
- upload_from_aipha_to_s3_folder(client,access_key_id=’YOUR_KEY_ID’,secret_access_key=’YOUR_SECRET_KEY’,aws_region=’eu-central-1’,target=’/target’,location=’file.laz’,bucket_name=’Your S3 bucket’,worker_instance_type=’x2large’,manager_instance_type=”small”,extension_target=”.laz”,skip_existing_files = False )
- Parameters:
access_key_id – AWS access key ID
secret_access_key – AWS secret access key
aws_region – AWS region
location – Location of file to upload on s3
bucket_name – S3 bucket name
folder_target – Path to upload from aipha
worker_instance_type – cloud instance type of worker nodes
manager_instance_type – cloud instance type of manager node
extension_target – File extension of files in folder for folder_target
skip_existing_files – skip files that already exist in the output folder