Category: Azure Data Factory

  • Data Factory Databricks Job activity parameterization

    —

    by

    Alexandre Cloud Silva

    With Databricks Jobs being possible to be called from Azure Data Factory (not available in Azure Synapse Analytics as time of writing: November 2025), and being already Generally Available, one concern which might arise is working with JobIDs parameterization when promoting code to higher environments. Purely, as an observation, when using this activity, the Job…

  • SHIR release notes notification automation

    —

    by

    Alexandre Cloud Silva

    The goal of this article is to: For Azure Data Factory (and Synapse Analytics) users, keeping up with SHIR (Self-Hosted Integration Runtime) notes might be a cumbersome task. It involves downloading a .doc file, costing a couple of clicks, through the following url: https://www.microsoft.com/en-us/download/details.aspx?id=39717 Having this in mind, I have created an automation to send…

  • Trigger VS Debug

    —

    by

    Alexandre Cloud Silva

    Azure Data Factory (ADF) offers 2 ways of executing a pipeline: Selecting Debug actually runs the pipeline. For example, if the pipeline contains copy activity, the test run copies data from source to destination. As a result, we recommend that you use test folders in your copy activities and other activities when debugging. After you’ve debugged the…