Common Properties of Transformers

Transformers have both input and output ports. They can:

Metadata can be propagated through some of these transformers, whereas the same is not possible in such components that transform data flows in a more complicated manner. You must have the output metadata defined prior to configuring these components.

Some of these transformers use transformations that have been described above. See Defining Transformations for detailed information about how transformation should be defined.

Below is an overview of all Transformers:

Table 50.1. Transformers Comparison

Component Same input metadata Sorted inputs Inputs Outputs Java CTL Auto-propagated metadata
Aggregate-
no
11
no
no
no
Concatenate
yes
no
1-n1
no
no
yes
DataIntersection
no
yes
23
yes
yes
yes
DataSampler-
no
1n
no
no
yes
Dedup-
yes
11-2
no
no
yes
Denormalizer-
no
11
yes
yes
no
ExtSort-
no
11-n
no
no
yes
FastSort-
no
11-n
no
no
yes
Filter-
no
11-2
no
no
yes
LoadBalancingPartition-
no
11-n
no
no
yes
Merge
yes
yes
2-n1
no
no
yes
MetaPivot-
no
11
no
no
yes
Normalizer-
no
11
yes
yes
no
Partition-
no
11-n [1] [1]
yes
Pivot-
no
11
yes
yes
no
Reformat-
no
11-n
yes
yes
yes
Rollup-
no
11-n
yes
yes
no
SimpleCopy-
no
11-n
no
no
yes
SimpleGather
yes
no
1-n1
no
no
yes
SortWithinGroups-
yes
11-n
no
no
yes
XSLTransformer-
no
11
no
no
no

[1]  Partition can use either the transformation or two other attributes (Ranges or Partition key). A transformation must be defined unless one of these is specified.