PinnedAzure data factory: How To Use Append Variable & Convert to StringThis article shows how to use append variable activity and convert an array to a comma-separated string.Sep 30, 2024Sep 30, 2024
PinnedDoes Data Governance Confuse You? Start with these 3 simple steps.I’m going to begin with what’s obvious but not openly stated — Data governance is confusing to a lot and downright boring to the rest…Sep 23, 2024Sep 23, 2024
PinnedAzure Data Factory- How to use Filter activity to filter array? A practical example.This article demonstrates how to use filter activity in Azure data factory with an example.Mar 15, 2024Mar 15, 2024
PinnedPublished inArt of Data EngineeringADF-What are Global Parameters & How to Use Them?Create global parameters in ADF to prevent hard coding values in your pipeline.Jan 22, 2024Jan 22, 2024
PinnedPublished inCodeXAzure Logic App- Fetch Secret Expiry Date & Other Metadata into a CSVUse logic app to read and export expiry date of a secret along with all the other key information into a csv file.Jan 18, 20241Jan 18, 20241
Short Article: Azure Data Factory’s Copy Does not Support Excel as DestinationAs the title suggests, this will be a very short article.Mar 25, 2024Mar 25, 2024
Published inData Engineer ThingsBehind the Scenes: The Unspoken Challenges of Data EngineeringIntrigued by the world of data engineering and considering a career in this exciting field? You are very welcome.Mar 21, 2024Mar 21, 2024
Published inArt of Data EngineeringAzure Data Factory- How to Generate Dynamic Date and DateTime valuesA crucial aspect of data integration is working with date and datetime values dynamically. Azure Data Factory (ADF) provides dynamic…Feb 3, 2024Feb 3, 2024
Published inCodeXDesigning an Effective Data Pipeline: Essential Questions I Always Ask.When embarking on a data engineering project, it’s natural to focus on the design of the data pipeline based on the requirements presented…Jan 30, 2024Jan 30, 2024
Published inData Engineer Things3 Practical Use Cases for Validation Activity in Azure Data FactoryUse ADF’s validation activity to determine if a dataset is presentJan 25, 20241Jan 25, 20241