I am performing data scraping of several web pages using For Each Row in Data Tabel activity.
The ExtractDT shape obtained from each page is as follows.
How to get temp_DT as below from ExtractDT?
How to add data to temp_DT to finally get final_DT as shown below?
It would be appreciated if you could look at the attached project file.
The purpose of this project is data scraping of 700 web pages. Each page’s Extracted data table has 6 rows with 1 column. I turned this into a data table ( ExtractDataTable_transposed) with 1 row with 6 columns using the Transpose DataTable activity (I tried also your Transpose DataTable activity). And the goal is to get the final file (result.xlsx) with 700 rows.
Please let me know the following:
Why does ExtractDataTable_transposed.Rows.Count.ToString show ‘0’? “tempResult.xlsx” is blank.
I found the way to turn around the problem above. I put the while activity into the if activity which has condition as dt_Final.Rows.Count=0.
There is one more thing I want to know.
Each iteration in For Each Row in DataTable activity, old data of dt_Final is removed and updated with new data. Is it possible to append new data to the row below the old data?