Transform

Second part of the ETL starts with T -- Transform

The transformation in ETL starts with the extraction of data from the selected data sources.

The Transformation looks like

The Transformation is divided into different sections.

Data Source

This section starts from the click of the Extract button, all the data from different sources are extracted and displayed. For now we are taking the data source as an Object and getting Account data.

Expected JSON

This is the section where the user needs to place the kind of JSON he is expecting. For now we can take the same Extracted JSON.

After the Expected JSON part there comes two sections which includes.

Key Value Mapper

he Key Value Mapper helps us to Map our Extracted JSON (Data Source JSON) with the Expected JSON. The Key Value Mapper provides one functionality to Add All Expected from the Expected JSON. The Add All functionality works only when the Expected JSON is provided.

The Add All Functionality takes out all the keys from the Expected JSON and gives the feature to map with any of the value from the Extracted JSON.

Transform Map Value

The Transform Map Value adds on a feature to set the default value for a particular key from the Key Value Mapper based on certain conditions.

At a time the user can set the default value for different keys from the Expected JSON. The user needs to provide the Key of the Expected JSON and default value. The Value Map is used to set put an extra check on the value of the Expected Path.

If any of the Key from the Value Map matches the Value of The Expected Path then the corresponding Value of the Value Map will be replaced with the Value of the Expected Key Path. If none of the value matches then the default value will be replaced.

Preview

After this all the User can Save the ETL and Run The ETL. On Successful Execution, the User can see the desired result on the Preview Section.

Here we are setting the details in the Value Map, if it matches then it will be replaced with Edge Communication else it will be replaced with Edge.

As the value matched with the First element of the JSON so, the name is replaced with Edge Comm. And on Successful run we are able to see the Preview.

Output JSON

This shows us the Key Value Mapper as in the JSON Format.

As we wrap up our exploration of the Transform phase in this section, the spotlight now shifts to the Load realm. Join us in the next section as we delve into the intricacies of the Load stage, unraveling the power of data metamorphosis and its pivotal role in shaping a comprehensive ETL process.