I know this topic has been raised up a few times already, but I still can’t find the solution.
MAIN TASK is:
1 To crap data from the web from multiple pages (I limited it as 4 pages for now).
2 Merge all data from multiple pages into 1 Excel file. (So every loop new data will be added to the previous one)
1 I created WHILE loop
2 Then, by using Data Scraping Wizard I identified what data to scrap (when it asked me about multiple pages, I said NO)
3 All scraped data then goes to ExtractDataTable1 variable
4 Data gets saved by Append Range activity to Excel file
5 Clear Data Table (ExtractDataTable1)
6 Then is scrolls down to the bottom of the page
7 Press down page 2,3,4 etc.
(looping whole process again)
THE PROBLEM is, in resulting Excel file, I get same data only from Page1 to be saved repeatedly right after another, so If I scrap four pages, in result I get 100 records (25 from each page), but they just repeat each other. What I want to achieve is to have all data from four pages added one after another in one Excel file.
For reference, I put Write Line activity (ExtractDataTable1.Rows.Count.Tostring) to check if the DataTable get cleared to null or not. It returns nothing.
I have attached my workflow screenshot, please help me to figure out what I am doing wrong.
Thanks in advance.