PinnedTech ZeroAzure Data Factory- How to use Filter activity to filter array? A practical example.This article demonstrates how to use filter activity in Azure data factory with an example.·4 min read·Mar 15, 2024----
PinnedTech ZeroinData Engineer Things3 Practical Use Cases for Validation Activity in Azure Data FactoryUse ADF’s validation activity to determine if a dataset is present·4 min read·Jan 25, 2024--1--1
PinnedTech ZeroinArt of Data EngineeringADF-What are Global Parameters & How to Use Them?Create global parameters in ADF to prevent hard coding values in your pipeline.·4 min read·Jan 22, 2024----
PinnedTech ZeroinCodeXAzure Logic App- Fetch Secret Expiry Date & Other Metadata into a CSVUse logic app to read and export expiry date of a secret along with all the other key information into a csv file.·4 min read·Jan 18, 2024--1--1
PinnedTech ZeroIdempotency in Azure: What Is It and Why Is It Important in Data Engineering?Achieve Data Consistency and Error Resilience in Azure Data Engineering with Idempotent Data Pipelines.·4 min read·Dec 11, 2023----
Tech ZeroShort Article: Azure Data Factory’s Copy Does not Support Excel as DestinationAs the title suggests, this will be a very short article.1 min read·Mar 25, 2024----
Tech ZeroinData Engineer ThingsBehind the Scenes: The Unspoken Challenges of Data EngineeringIntrigued by the world of data engineering and considering a career in this exciting field? You are very welcome.4 min read·Mar 21, 2024----
Tech ZeroinArt of Data EngineeringAzure Data Factory- How to Generate Dynamic Date and DateTime valuesA crucial aspect of data integration is working with date and datetime values dynamically. Azure Data Factory (ADF) provides dynamic…·3 min read·Feb 3, 2024----
Tech ZeroinCodeXDesigning an Effective Data Pipeline: Essential Questions I Always Ask.When embarking on a data engineering project, it’s natural to focus on the design of the data pipeline based on the requirements presented…4 min read·Jan 30, 2024----
Tech ZeroinArt of Data EngineeringAzure Data Factory — How to create generic datasets and why they matter?How generic datasets in ADF remove redundancy and make ADF leaner.·6 min read·Jan 15, 2024----