Home | Table of Contents | Jobflow Design Patterns | CloverETL 4.6.1
--- | --- | ---
Prev | Jobflow | Next

# Chapter 47. Jobflow Design Patterns

### Try/Catch Block

All execution components simply allow to react to success and failure. In case of job success, token is send to the first output port. In case of job failure, token is send to the second output port.

### Try/Finally Block

All execution components allow to redirect the error token to the first output port. Use 'Redirect error output' attribute for uniform reaction to job success and failure.

### Sequential Execution

Sequential jobs execution is performed by simple execution components chaining. Failure of any job causes jobflow termination.

### Sequential Execution with Error Handling

Sequential jobs execution can be extended by common job failure handling. Component TokenGather is suitable for gathering all tokens representing job failures.

### Parallel Execution

Parallel jobs execution is simply allowed by set of independent executors. Reaction to success and failure is available for each individual job.

### Parallel Execution with Common Success/Error Handling

Barrier component allows to react to success or failure of parallel running jobs. By default, group of parallel running jobs is considered successful if all jobs finished successfully. Barrier component has various settings to satisfy all your needs in this manner.

### Conditional Processing

Conditional processing is allowed by token routing. Based on results of Job A you can decide using Condition component which branch of processing will be used afterwards.

### Dictionary Driven Jobflow

Parent jobflow can pass some data to child job using input dictionary entries, these job parameters can be read by GetJobInput component and can be used in further processing. On the other side jobflow results can be written to output dictionary entries using SetJobOutput component. These results are available in parent jobflow.

### Fail Control

You can intentionally stop processing of jobflow using Fail component. User-specified message can be reported by Fail component.

### Asynchronous Graphs Execution

Parallel processing of variable number of jobs is allowed using asynchronous job processing. The example bellow shows how to process all csv files in parallel way. First, all file names are listed by ListFiles component. Single graph for each file name is asynchronously executed by ExecuteGraph component. Graph run identifications (runId) are sent to MonitorGraph component which waits for all graph results.

Asynchronous execution is available only for graphs and jobflows.

### File Operations

Jobflow provides set of file operations component - list files, create, copy, move and delete files. This use-case shows how to use file operation components to process set of remote files. The files are downloaded from remote FTP server, each file is processed by a job, results are copied to a final destination and possible temporary files are deleted.

### Aborting Graphs

Graphs and jobflows can be explicitly aborted by KillGraph respectively by KillJobflow components. The example bellow shows how to process a list of tasks in parallel way and jobs which reached user-specified timeout are automatically aborted.

Prev | Up | Next
Jobflow Overview | Home | Table of Contents | Component Reference