Member-only story
ADF Pipeline— Looking To Copy a Specific File From a List of Files? Here’s How.
This article explains how to use ADF’s path to file list property during copy activity.
In Azure Data Factory (ADF) pipeline, we can use List of files property to tell ADF to copy a particular file but ignore the others. Here’s how to use it.
Test Set Up
I have a folder in my ADLSG2 (Azure Data Lake Gen 2) container with multiple files. I need to copy Test file 3.csv and Test file 4.csv out of this folder.
In ADF canvas, I will drag and drop the copy data activity and connect my source to the above folder. The sink location (also known as destination) will be another folder in the same ADLSG2 container.
As shown above, I picked the List of files radio button to complete my use case.