This article explains how to store dynamic filenames with ADF’s Mapping Data Flow.

As a Data Engineer, I find capturing filenames is as important of an information as ensuring data quality. Numerous projects that I worked upon needed me to store the filenames in a separate attribute just so I can have additional information about which file supplied a particular set of data.

This article explains how to use Logic Apps to copy mail attachments to Azure blob storage.

Azure Logic Apps is a powerful tool that you can make use of to copy email attachment to Azure Blob Storage. This articles shows the steps needed to achieve the same.

You receive daily emails (outlook account) with excel spreadsheet as an attachment. You are required to copy the spreadsheet…

This article explains how to run a python script in Azure Automation.

Let’s say you work in a team of 10 Data Engineers. Each engineer has developed a pipeline for a specific project that involves bringing data into temporary containers in Blob Storage. The containers are created at runtime. When the pipelines execute, the Project Manager needs a list of all such…

Tech Zero

I work as a Data Engineer which means on any day I'm involved in creating, maintaining and optimizing data infrastructure and data stores for data pipelines.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store