Lab Reprocessing "(Informatica) Stress Test 1: Flat to Flat", over a new hardware platform. The times achieved were about 19 seconds. |
|
In this first Test of 2013, we return to measure the test (Informatica) Stress Test 1: Flat to Flat on the New Architecture. In the previous version, this Premium tool in Data Integration, had been relegated by the low resources allocated. This time, times were fairly good, passing from 422 to about 19 seconds.
Is remarkable the change, not only on the results achieved, but also in the usability of the tool.
Among the properties that were modified to adjust the test to the new environment, we mention Maximum Memory Allowed.., Maximum Percentage of total memory, Line Sequential buffer length.
As in all previous tests, at the end of the same, there is a measurement of resources: Memory - Disk - Network when running the Job.
TIMES:
ARCHITECTURE: Environment: Infraestructure composed of 3 nodes 1) ESXi 5.0: a) Physical Datastore 1: VM ETL Informatica (10GB RAM - 2 Cores * 2 Sockets) b) Physical Datastore 2: VM Database Server MySQL (6GB RAM - 2 Cores * 2 Sockets) 2) Monitor Performance: VM Monitor ESXi + SQL Server 2008 (with 4 GB RAM) 3) Operator ETL: ESXi Client (with 4 GB RAM) |
![]() |
CASE 1: -BufferLn 4GB, Max % Use of Memory: 90%
Objective: |
To measure elapsed time reading & writing 6 million rows, from Flat file to CSV file, working on local disk. |
ETL Tool | Informatica 8 |
Rows: | 6.024.000 M |
Columns: | 37 Columns |
Structure: (Metadata) |
|
Design & Run |
Flow:
Properties:
Partitions: |
LOG |
Log: |
Elapsed time (s) | 19 Secs vs 422 secs (VERSION 1) |
Rows p/s (avg) |
317.051 rows/sec VS 14.300 rows/sec |
How to Improve Performance |
- Adjust the parameters: I/0, %Memory to Use, Buffer Size |
USE OF RESOURCES: VM INFORMATICA
CPU: |
CPU Monitoring, "Passive and Active state" in different executions. Last Execution: 11:00-11:02 |
Memory: |
Memory Monitoring: Last Execution: 11:00 - 11:02 |
Network |
Network Monitoring: Last Execution: 11:00 - 11:02 |
DataST |
|