Posts

Showing posts from August, 2023

Azure Data Factory | Copy multiple tables in Bulk with Lookup Activity & ForEach

  Shivani Mishra - Easy Azure for Everyone Introduction to Azure Data Factory Lookup and ForEach Actions In this blog, we will learn how to build dynamic pipelines in Azure Data Factory using lookup and forEach actions. The lookup action allows you to retrieve a data set from a file or table within your database, and you can use this data set to determine the list of objects that you want to work with in your pipeline. The lookup action supports most of the data sources currently supported in Data Factory, so you can use various types of databases or flat file solutions. The lookup action is often paired with the forEach action, which allows you to execute a set of activities for each object in the list returned by the lookup action. This blog will walk you through a step-by-step setup of a pipeline that lists tables from a SQL database using a lookup activity, and then iterates over the results to perform a simple copy extraction. Step-by-Step Setup Initial S...