ParallelSimpleCopy

Not available in Community Designer

Short Description
Ports
Metadata
Details
Compatibility
See also

Short Description

ParallelSimpleCopy copies incoming data records to all output CloverETL Cluster workers. The algorithm of the component is derived from the regular SimpleCopy component.

Component Same input metadata Sorted inputs Inputs Outputs Java CTL Auto-propagated metadata
ParallelSimpleCopy
yes
no
11 [1]
no
no
yes

[1]  The single output port represents multiple virtual output ports.

Icon

Ports

Port typeNumberRequiredDescriptionMetadata
Input0
yes
For input data recordsAny
Output0
yes
For output data recordsInput 0

Metadata

ParallelSimpleCopy propagates metadata in both directions. ParallelSimpleCopy does not change priorities of propagated metadata.

The component has no metadata template.

ParallelSimpleCopy does not require any specific metadata fields.

Details

ParallelSimpleCopy copies incoming data records to all output CloverETL Cluster workers. Each incoming record is duplicated and sent to all output partitions.

This component is useful whenever you need to have some data available for all workers. For example, you decide to process a large number of your business transactions in a parallel way. ParallelPartition is the right component to split your data among several workers. Now you realize you need to join your transactions for example with country codes, where the transactions have been performed. The list of all country codes you need to have available on all workers. Each worker can acquire the country codes individually, but if the data reading is very expensive, for example reading from a slow web service, it could be favorable to read them once and copy them among all workers using clover abilities. So you can read the country codes from a slow data source just once on a single worker and copy them using ParallelSimpleCopy to all workers, where they can be used to join with your transactions.

The algorithm of this component is derived from the regular SimpleCopy component. See the documentation of the SimpleCopy component for more details.

This component belongs to group of cluster components that allows the change from a single-worker allocation to a multiple-worker allocation. So the allocation of the component preceding the ParallelSimpleCopy component has to provide just a single worker. The allocation of the component following the ParallelSimpleCopy component can provide multiple workers.

[Note]Note

More details about usage of this component is available in CloverETL Cluster documentation.

Compatibility

3.4.

The component is available since version 3.4.

4.3.0-M2

In 4.3.0-M2, ClusterSimpleCopy was renamed to ParallelSimpleCopy.

See also

ParallelLoadBalancingPartition
ParallelMerge
ParallelPartition
ParallelSimpleGather
SimpleCopy
Common Properties of Components
Specific Attribute Types
Common Properties of Data Partitioning Components