Member-only story
This article explains how to use the retry feature in ADF copy activity.
When using Azure Data Factory’s Copy activity, you can encounter multiple failures. However, if any/none of those failures are due to the underlying logic but are triggered due to a connection reset, Java Native Interface error etc., you have the option to authorize ADF to retry the copy activity.
In the image below, I have a copy activity. Under the general settings, we see that there are options for Retry and Retry interval in seconds. The default option for retry is 0 which means if your copy activity fails once then this will be logged as a failure in the overall data pipeline status.
As the author of the pipeline, I can set the retry option to 3 and the retry interval to 60 seconds. This setting tells ADF if the copy activity fails, retry the failed action again after 60 seconds. If it fails again, ADF will attempt to re-execute the same action for a total of 3 times at 60 seconds each.
If you are using this feature within a for loop and the activity fails for the first time but succeeds on the next attempt, the overall status of the for loop will be marked a success.
