Movie webpage to get names of all the movies using data scrapping?

Help
, ,
1

Hi there,

I am doing data scrapping from a website of 10 pages.

I am using (next button to move to the next page ) I am able to get the data correctly but on the last page there is no (next button) How do I stop the execution when it is on the last page?

Thanks,
Auto

d
d674×601 125 KB

2

@ENGINEERING_FAIL Use try catch activity and insert your data scrap actvity in try block and in the catch block use write line activity to catch the exception

3

@ENGINEERING_FAIL I believe if you are scraping it through Data Scraping wizard than it would automatically stop at the last page and take you to the next step in you workflow.

Thanks,
Rammohan B.

4

@Rammohan91

I know that bro.
But still it’s getting stuck on the last page (when next page not visible) and none of the information is not getting extracted into the provided excel document.
Thanks and regards,
Me

5

@ENGINEERING_FAIL Is it possible to access the link from where you are trying to scrape?

Thanks,
Rammohan B.

6

@Rammohan91 yes. It is possible.

7

@ENGINEERING_FAIL Can you please provide that?

Thanks,
Rammohan B.

8

@ENGINEERING_FAIL Also, i hope ‘ContinueOnError’ property is set to ‘True’.

Thanks,
Rammohan B.

10

Hi @ENGINEERING_FAIL,

I did similar project - Using while loop and imagine exists.

image

Use Imagine Exists for the “Next” Button
Set default value for item as True (Should be default)
While item = True, do data scrapping

Put Imagine Exists at the bottom of the while loop.

So when it doesn’t see the “Next” button, item will switch to False and it will exit the while loop.

Hope it helps!

Regards,
Lavina

1 Like