Transformation flows in SAP Datasphere can handle highly complex operations, but this often comes at the expense of performance. It can be difficult to pinpoint exactly where the bottlenecks are. Where exactly is time being wasted? Which steps require the most resources? Where can performance be optimized? These are questions that developers deal with every day.
The function for generating PlanViz files now provides you with the answer. Instead of groping in the dark, you can clearly see how your transformation flows operate. A visual overview shows you directly how much time and resources each step consumes. This allows you to immediately identify bottlenecks and optimize performance in a targeted manner. In this article, you’ll learn how it works.
The best way to illustrate how this feature works is with an example. We will use a transformation flow with a join and calculations. One table contains sales figures, while the other holds sales costs.
Both tables contain daily data. From this, we want to derive the year and month. In addition, the gross profit is calculated. Finally, the fields are mapped to the target table.
To analyze the performance of this transformation flow, open the Transformation Flow Monitor.
Alternatively, you can access it via the Data Integration Monitor menu item. Select the space you're using and then select your data flow in the Flows tab. Click the > icon to display the details.
Then open the drop-down menu under Run and select the option Run with Support Settings.
In the next dialog window, select the option Generate SQL Analyzer Plan File and execute the transformation flow using Start Run.
Next to the message “SQL Analyzer plan file for the transformation flow is created and can be downloaded” you can download the PlanViz (*.plv) file.
The file is analyzed in Eclipse using SAP HANA PlanViz. Alternatively, you can use the Visual Studio Code extension SQL analyzer tool for SAP HANA. Open Eclipse and follow the menu path Window → Perspective → Open Perspective → Other.
Then select the SAP HANA PlanViz entry and confirm your selection with Open.
Now open the downloaded file via File → Open File. The overview displays the execution time, the most important operators, the number of tables and records.
You can see the details in the Executed Plan view. Each execution step is displayed, allowing you to track the duration, number of records, and operations performed. You can track the respective duration, number of data records, and the operations performed. We have already presented these in our article “SQL Performance Analysis with SAP PlanViz.” There, we also explained the Timeline, Operator List, Tables Used, and Performance Trace tabs.
Be sure to check it out!
With PlanViz logs in SAP Datasphere, you now have a precise tool to analyze data flow performance. Instead of relying on guesswork, developers now have a solid basis for detailed analysis. The visual representation of complex data processing flows makes performance bottlenecks immediately visible and enables targeted optimization measures.
The granular breakdown of individual processing steps with specific runtimes is particularly valuable. Based on these insights, you can make informed decisions, carry out targeted optimizations, and sustainably increase the efficiency of your transformation flows. IT teams spend less time on root cause analysis and more on strategic data architecture—leading to more robust and efficient integration processes.
Do you have questions about SAP Datasphere? Are you trying to build up the necessary know-how in your department or do you need support with a specific question? We are happy to help you.
Request a non-binding consulting offer today!