advertisement
Viewing Performance Details in the Performance Details File
The Integration Service creates a performance detail file for the session when it completes. Use a text editor to view the performance details file.
To view the performance details file:
1.
Locate the performance details file.
The Integration Service names the file session_name.perf, and stores it in the same directory as the session log. If there is no session-specific directory for the session log, the Integration Service saves the file in the default log files directory.
2.
Open the file in any text editor.
Understanding Performance Counters
All transformations have some basic counters that indicate the number of input rows, output rows, and error rows.
Source Qualifier, Normalizer, and target transformations have additional counters that indicate the efficiency of data moving into and out of buffers. Use these counters to locate performance bottlenecks.
Some transformations have counters specific to their functionality. For example, each Lookup transformation has a counter that indicates the number of rows stored in the lookup cache.
When you view the performance details file, the first column displays the transformation name as it appears in the mapping, the second column contains the counter name, and the third column holds the resulting number or efficiency percentage. If you use a Joiner transformation, the first column shows two instances of the Joiner transformation:
¨ <Joiner transformation> [M]. Displays performance details about the master pipeline of the Joiner transformation.
¨ <Joiner transformation> [D]. Displays performance details about the detail pipeline of the Joiner transformation.
When you create multiple partitions, the Integration Service generates one set of counters for each partition. The following performance counters illustrate two partitions for an Expression transformation:
Transformation Name
EXPTRANS [1]
EXPTRANS [2]
Counter Name
Expression_input rows
Expression_output rows
Expression_input rows
Expression_output rows
Counter Value
8
8
16
16
Note: When you increase the number of partitions, the number of aggregate or rank input rows may be different from the number of output rows from the previous transformation.
Performance Details 201
The following table describes the counters that may appear in the Session Performance Details area or in the performance details file:
Transformation
Aggregator and Rank
Transformations
Lookup
Transformation
Counters
Aggregator/Rank_inputrows
Aggregator/Rank_outputrows
Aggregator/Rank_errorrows
Aggregator/Rank_readfromcache
Aggregator/Rank_writetocache
Aggregator/Rank_readfromdisk
Aggregator/Rank_writetodisk
Aggregator/Rank_newgroupkey
Aggregator/Rank_oldgroupkey
Lookup_inputrows
Lookup_outputrows
Lookup_errorrows
Lookup_rowsinlookupcache
Description
Number of rows passed into the transformation.
Number of rows sent out of the transformation.
Number of rows in which the Integration Service encountered an error.
Number of times the Integration Service read from the index or data cache.
Number of times the Integration Service wrote to the index or data cache.
Number of times the Integration Service read from the index or data file on the local disk, instead of using cached data.
Number of times the Integration Service wrote to the index or data file on the local disk, instead of using cached data.
Number of new groups the Integration Service created.
Number of times the Integration Service used existing groups.
Number of rows passed into the transformation.
Number of rows sent out of the transformation.
Number of rows in which the Integration Service encountered an error.
Number of rows stored in the lookup cache.
202 Chapter 13: Workflow Monitor Details
Transformation
Joiner
Transformation
(Master and Detail)
Counters
Joiner_inputMasterRows
Joiner_inputDetailRows
Joiner_outputrows
Joiner_errorrows
Joiner_readfromcache
Joiner_writetocache
Joiner_readfromdisk
Joiner_writetodisk
Joiner_readBlockFromDisk
Joiner_writeBlockToDisk
Joiner_seekToBlockInDisk
Joiner_insertInDetailCache
Joiner_duplicaterows
Joiner_duplicaterowsused
Description
Number of rows the master source passed into the transformation.
Number of rows the detail source passed into the transformation.
Number of rows sent out of the transformation.
Number of rows in which the Integration Service encountered an error.
Number of times the Integration Service read from the index or data cache.
Number of times the Integration Service wrote to the index or data cache.
Number of times the Integration Service read from the index or data files on the local disk, instead of using cached data.
The Integration Service generates this counter when you use sorted input for the Joiner transformation.
Number of times the Integration Service wrote to the index or data files on the local disk, instead of using cached data.
The Integration Service generates this counter when you use sorted input for the Joiner transformation.
Number of times the Integration Service read from the index or data files on the local disk, instead of using cached data.
The Integration Service generates this counter when you do not use sorted input for the Joiner transformation.
Number of times the Integration Service wrote to the index or data cache.
The Integration Service generates this counter when you do not use sorted input for the Joiner transformation.
Number of times the Integration Service accessed the index or data files on the local disk.
The Integration Service generates this counter when you do not use sorted input for the Joiner transformation.
Number of times the Integration Service wrote to the detail cache. The Integration Service generates this counter if you join data from a single source.
The Integration Service generates this counter when you use sorted input for the Joiner transformation.
Number of duplicate rows the Integration Service found in the master relation.
Number of times the Integration Service used the duplicate rows in the master relation.
Performance Details 203
Transformation
All Other
Transformations
Counters
Transformation_inputrows
Transformation_outputrows
Transformation_errorrows
Description
Number of rows passed into the transformation.
Number of rows sent out of the transformation.
Number of rows in which the Integration Service encountered an error.
If you have multiple source qualifiers and targets, evaluate them as a whole. For source qualifiers and targets, a high value is considered 80-100 percent. Low is considered 0-20 percent.
204 Chapter 13: Workflow Monitor Details
advertisement
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project