Amazon S3 Connection
This page shows how to connect to Amazon S3 and how to write SAP data to an S3 bucket. This involves 3 main steps:
Connect to Amazon S3
To create a connection to an Amazon S3 bucket:
- Navigate to the Connections menu at the left side navigation area of the Designer.
- Click [Add Connection] to create a new Amazon S3 connection or click to edit an existing connection.
- When creating a new connection, select the connection type Amazon S3 and enter a unique name for the connection.
- Click [Next].
- Enter the connection details of your Amazon S3 bucket. For more information, see Amazon S3 connection settings.
- Click [Test Connection] to validate the connection parameters.
A window with a status message opens in the bottom right corner of the window. - Click [Save] to save the connection.
The connection can be used as a destination for writing SAP data:
Assign the Amazon S3 Destination to a Service
You can assign the Amazon S3 connection as a destination when creating or editing a service. When you run the service, the data is written directly to the Amazon S3 bucket.
Amazon S3 Connection Settings
Authentication
yunIO uses AWS Access Keys (an access key ID and secret access key) to authenticate with AWS services. These credentials are managed by AWS Identity and Access Management (IAM).
Access Key
The access key ID is a 20-character, alphanumeric string, e.g., AKIAIOSFODNN7EXAMPLE. You can find or generate access keys in the AWS Management Console by navigating to:
IAM > Users > [Your User] > Security credentials.
Secret Key
The secret access key is a 40-character string, e.g., wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY. Note that secret keys are shown only once at creation time. Make sure to copy them and store them in a safe location.
System
Buckets name
Click to load or refresh the list of available buckets. Select a bucket from the drop-down list. The SAP data is written into the selected bucket.
Region
Select the region of your Amazon S3 bucket.
Test Connection
Click [Text Connection] to validate your connection settings. A status message is displayed at the bottom right corner of the screen.
Amazon S3 Destination Settings
Destination settings define how and where a service saves its output data, such as the target folder and file name. Once you assign an Amazon S3 destination to a service, the "Destination Settings" menu becomes available in the service's settings.
File Name
Custom File Name
Defines the name of the target file. Enter a name of your choice.
Note
If the name of the object does not begin with a letter, it will be prefixed with an ‘x’, e.g. an object by the name _namespace_tabname.csv will be renamed x_namespace_tabname.csv when uploaded to the destination. This is to ensure that all uploaded objects are compatible with Azure Data Factory, Hadoop and Spark, which require object names to begin with a letter or give special meaning to objects whose names start with certain non-alphabetic characters.
Append Timestamp
Adds a timestamp in the UTC format (_YYYY_MM_DD_hh_mm_ss_fff) to the end of the file name.
Column Name Style
Defines the style of the column name. Following options are available:
| Option | Description |
|---|---|
| Code | The SAP technical column name is used as column name in the destination e.g., MAKTX. |
| PrefixedCode | The SAP technical column name is prefixed by SAP object name and the tilde character e.g., MAKT~MAKTX |
| CodeAndText | The SAP technical column name and the SAP description separated by an underscore are used as column name in the destination e.g., MAKTX_Material Description (Short Text). |
| TextAndCode | The SAP description and the SAP technical column name description separated by an underscore are used as column name in the destination e.g., Material Description (Short Text)_MAKTX. |
| Text | The SAP description is used as column name in the destination e.g., Material Description (Short Text). |
Convert dates
Converts the character-type SAP date (YYYYMMDD) to a special date format (YYYY-MM-DD), e.g., 19900101 becomes 1990-01-01. Target data uses a real date data-type and not the string data-type to store dates.
Year 0
Converts the SAP date 00000000 to the entered value.
Year 9999
Converts the SAP date 9999XXXX to the entered value.
Invalid values
If an SAP date cannot be converted to a valid date format, the invalid date is converted to the entered value. NULL is supported as a value. When converting the SAP date the two special cases 00000000 and 9999XXXX are checked first.
Folder
Writes the extracted data to a specific folder structure within the bucket. If the specified folder does not exist, it is created.
- Create a single folder by entering a folder name without slashes:
folder - Create subfolders using the following syntax:
folder/subfolder_1/subfolder_2/...