This article explains how to store dynamic filenames with ADF’s Mapping Data Flow.

As a Data Engineer, I find capturing filenames is as important of an information as ensuring data quality. Numerous projects that I worked upon needed me to store the filenames in a separate attribute just so I can have additional information about which file supplied a particular set of data.

This article explains how to use Logic Apps to copy mail attachments to Azure blob storage.

Azure Logic Apps is a powerful tool that you can make use of to copy email attachment to Azure Blob Storage. This articles shows the steps needed to achieve the same.

Task:
You receive daily emails (outlook account) with excel spreadsheet as an attachment. You are required to copy the spreadsheet…

This article explains how to run a python script in Azure Automation.

Let’s say you work in a team of 10 Data Engineers. Each engineer has developed a pipeline for a specific project that involves bringing data into temporary containers in Blob Storage. The containers are created at runtime. When the pipelines execute, the Project Manager needs a list of all such…

Tech Zero

I work as a Data Engineer which means on any day I'm involved in creating, maintaining and optimizing data infrastructure and data stores for data pipelines.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store