In order to only insert new values, I'd recommend you to tag each row of data with a unique identifier. Then insert a logic that checks whether that identifier already exists in the DB or not.
See if the below article helps -
In order to only insert new values, I'd recommend you to tag each row of data with a unique identifier. Then insert a logic that checks whether that identifier already exists in the DB or not.
See if the below article helps -
Product Manager, Data & Governance | Azure, Databricks and Snowflake stack | Here to share my knowledge with everyone